-- Logs begin at Tue 2022-07-12 06:32:17 UTC, end at Tue 2022-07-12 07:33:36 UTC. -- Jul 12 07:04:12.096479 dv-cinder-825492-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 07:04:12.106401 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 07:04:12 2022] *** Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: nodename: dv-cinder-825492-25-iscsi Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: machine: x86_64 Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: clock source: unix Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: pcre jit disabled Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: detected number of CPU cores: 4 Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: current working directory: / Jul 12 07:04:12.108842 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: detected binary path: /usr/bin/uwsgi-core Jul 12 07:04:12.109972 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: your processes number limit is 47680 Jul 12 07:04:12.109972 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: your memory page size is 4096 bytes Jul 12 07:04:12.109972 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: detected max file descriptor number: 2048 Jul 12 07:04:12.109972 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: lock engine: pthread robust mutexes Jul 12 07:04:12.109972 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: thunder lock: enabled Jul 12 07:04:12.109972 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 07:04:12.109972 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 07:04:12.158224 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: Python main interpreter initialized at 0x55ad813729c0 Jul 12 07:04:12.158224 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: python threads support enabled Jul 12 07:04:12.158224 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: your server socket listen backlog is limited to 100 connections Jul 12 07:04:12.158224 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: your mercy for graceful operations on workers is 90 seconds Jul 12 07:04:12.158579 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 07:04:12.158644 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: *** Operational MODE: preforking *** Jul 12 07:04:12.158896 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: *** uWSGI is running in multiple interpreter mode *** Jul 12 07:04:12.158896 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: spawned uWSGI master process (pid: 103467) Jul 12 07:04:12.159104 dv-cinder-825492-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 07:04:12.159873 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: spawned uWSGI worker 1 (pid: 103468, cores: 1) Jul 12 07:04:12.159984 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: spawned uWSGI worker 2 (pid: 103469, cores: 1) Jul 12 07:04:12.163152 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 07:04:12.814811 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 07:04:12.826278 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 07:04:13.915844 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:04:13.915844 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: from cryptography.utils import int_from_bytes Jul 12 07:04:13.916496 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:04:13.916496 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: from cryptography.utils import int_from_bytes Jul 12 07:04:13.937036 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:04:13.937036 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: from cryptography.utils import int_from_bytes Jul 12 07:04:13.937581 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:04:13.937581 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: from cryptography.utils import int_from_bytes Jul 12 07:04:16.395497 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 07:04:16.396050 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 07:04:16.396417 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 07:04:16.396513 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 07:04:16.396597 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 07:04:16.396664 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 07:04:16.396741 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 07:04:16.396834 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 07:04:16.396915 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 07:04:16.396988 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 07:04:16.397198 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.397362 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.397574 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.397728 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.397824 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.397907 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.398206 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.398334 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.398510 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.398657 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.398803 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.398937 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.399144 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.399302 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.399461 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.399592 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.399789 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.399935 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.400027 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.400121 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.400348 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.400482 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.400673 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-25-iscsi {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.400807 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-25-iscsi {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.400972 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.401104 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.401311 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.401456 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.401603 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.401704 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.401918 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.402018 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.402220 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.402312 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.402538 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.402704 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.402842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.402934 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.403325 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.403433 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.404510 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.404663 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.404663 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.404850 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.404938 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405019 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405170 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405272 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405355 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405434 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405561 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405653 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405732 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405823 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.405903 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.406033 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.406466 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.406635 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.406741 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.406983 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-25-iscsi {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.407082 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.407311 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.407418 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-25-iscsi {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.407622 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.407705 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.407936 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.408039 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.408365 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.408531 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.408646 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.408955 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.409298 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.409394 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.409716 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.409818 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.410039 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.410298 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.410385 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.410684 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.410860 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.410999 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.411190 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.411334 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.411515 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.411659 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.411842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.411982 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.412147 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.412308 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.412455 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.412616 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.412770 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.412927 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.413096 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.413270 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.413404 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.413594 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.413692 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.413904 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.414017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.414239 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.414390 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.414550 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.414638 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.414865 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.414954 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.415184 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.415274 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.415434 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.415536 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.415682 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.415819 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.416001 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.416090 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.416315 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.416489 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.416619 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.416706 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.416924 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.417012 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.417251 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.417489 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.417587 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.417911 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.417999 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.418320 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.418459 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.418637 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.418952 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.419051 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.419495 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.419594 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.419816 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.419941 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.420130 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.420272 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.420453 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.420614 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.420772 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.420935 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.421124 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.421291 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.421442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.421699 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.421830 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.422138 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.422521 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.422688 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.422866 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.422963 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.423192 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.423290 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.423507 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.423833 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.423920 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.424161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.424440 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.424529 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.424770 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.424982 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.425158 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.425379 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.425727 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.425813 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.426054 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.426368 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.426465 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.426765 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.426854 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.427022 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.427334 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.427428 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.427646 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.427950 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.428087 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.428274 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.428535 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.428665 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.428846 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.429185 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.429302 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.429503 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.429814 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.429901 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.430126 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.430366 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.430631 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.430718 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.430987 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.431181 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.431299 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.431613 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.431699 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.431926 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.432195 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.432282 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.432535 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.432715 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.432847 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.433183 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.433272 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.433498 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.433769 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.433856 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.434102 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.434295 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.434426 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.434750 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.434847 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.435061 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.435370 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.435456 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.435680 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.435909 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.436007 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.436299 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.436433 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.436609 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.436918 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.437018 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.437268 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.437526 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.437636 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.438078 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.438620 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.438718 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.439058 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.439161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.439375 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.439462 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.439689 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.439840 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.440018 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.440169 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.440315 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.440473 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.440636 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.440808 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.440956 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.441119 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.441263 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.441353 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.441571 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.441674 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.441878 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.441967 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.442185 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.442272 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.442491 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.442580 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.442796 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.442883 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.443104 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.443528 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.443750 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.443840 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.444053 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.444149 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.444358 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.444446 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.444665 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.444761 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.444979 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.445096 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.445313 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.445412 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.445634 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.445739 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.445961 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.446050 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.446271 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.446369 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.446581 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.446676 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.446892 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.446981 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.447222 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:04:16.447321 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.447566 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.447655 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.447905 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.447993 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.448262 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.448367 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.448579 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.448670 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.448921 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.449279 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.449547 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.449647 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.449919 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.450090 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.450233 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.450606 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.450707 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.450946 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.451089 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.451292 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.451385 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.451617 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.451715 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.451938 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.452026 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.452260 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.452358 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.452588 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.452686 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.452913 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.453011 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.453452 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.453781 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.453886 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.454105 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.454256 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.454433 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.454591 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.454748 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.454916 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.455070 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.455265 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.455405 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.455618 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.455742 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.455957 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.456058 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.456284 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.456378 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.456611 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.456729 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.456926 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.457073 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.457271 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.457405 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.457685 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.457777 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.457909 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.458035 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.458244 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.458338 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.458558 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.458643 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.458883 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.458978 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.459199 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.459296 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.459511 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.459597 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.459826 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.459990 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.460133 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.460271 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.460441 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.460591 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.460782 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.460923 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.461117 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.461208 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.461432 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.461532 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.461746 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.461832 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.462063 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.462152 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.462378 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.462480 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.462688 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.462774 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.462997 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.463083 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.463303 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.463445 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.463610 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.463699 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.463917 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.464004 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.464221 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.464319 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.464524 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.464610 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.464828 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.464915 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.465161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.465254 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.465469 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.465571 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.465791 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.465891 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.466120 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.466209 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.466427 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.466704 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.466806 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.467059 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.467270 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.467385 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.467642 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.467934 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.468038 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.468256 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.468493 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.468590 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.469019 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.469370 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.469459 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.469690 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.469780 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.470006 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.470100 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.470315 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.470402 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.470646 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.470734 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.470954 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.471040 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.471266 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.471366 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.471577 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.471671 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.471886 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.471973 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.472196 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.472282 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.472508 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.472595 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.472818 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.472905 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.473155 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.473326 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.473466 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.473641 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.473792 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.473958 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.474108 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.474281 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.474425 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.474620 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.474762 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.474930 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.475096 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.475262 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.475402 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.475592 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.475730 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.475912 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.476055 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.476221 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.476372 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.476677 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.476765 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.476986 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.477205 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.477423 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.477734 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.478042 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.478353 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.478618 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.478718 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.478949 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.479035 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.479252 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.479340 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.479555 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.479660 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.479860 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.479956 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.480182 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.480271 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.480495 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.480597 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.480801 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.480889 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.481130 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.481223 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.481435 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.481534 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.481780 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.481870 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.482085 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.482172 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.482430 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.482530 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.482767 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.483087 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.483173 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.483412 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.483662 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.483752 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.484025 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.484201 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.484704 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.485142 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.485320 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.485487 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.485769 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.486028 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.486129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.486401 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.486622 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.486711 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.487085 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.487174 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.487411 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.487728 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.487826 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.488049 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.488245 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.488567 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.488665 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.488892 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.489213 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.489305 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.489587 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.489771 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.489921 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.490243 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.490363 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.490579 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.490896 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.490983 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.491224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.491449 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.491536 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.491846 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.491998 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.492193 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.492531 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.492619 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.492852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.493081 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.493208 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.493525 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.493624 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.493844 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.494155 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.494244 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.494468 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.494701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.494798 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.495081 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.495235 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.495403 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.495716 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.495803 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.496037 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.496275 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.496362 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.496662 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.496827 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.496975 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.497406 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.497715 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.497801 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.497901 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.498114 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.498222 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.498450 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.498539 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.498772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.498867 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.499099 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.499202 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.499442 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.499530 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.499780 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.499871 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.500248 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.500563 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.500714 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.500896 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.501025 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.501244 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.501373 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.501566 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.501691 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.501887 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.502009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.502200 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.502329 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.502512 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.502651 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.502827 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.503032 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.503153 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.503382 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.503514 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.503695 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.503782 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.504016 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.504113 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.504329 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.504419 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.504638 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.504724 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.504944 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.505041 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.505273 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.505361 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.505587 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.505690 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.505905 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.506007 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.506217 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.506324 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.506683 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.506780 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.506870 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.507143 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.507502 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.507789 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.507887 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.508116 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.508220 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.508460 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.508549 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.508763 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.508849 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.509092 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.509273 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.509415 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.509504 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.509729 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.509818 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.510035 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.510131 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.510358 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.510447 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.510682 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.510769 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.510992 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.511097 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.511307 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.511395 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.511618 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.511705 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.511927 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.512033 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.512240 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.512342 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.512552 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.512638 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.512862 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.512959 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.513202 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.513304 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.513516 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.513660 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.513826 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.513959 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.514163 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.514261 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.514452 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.514568 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.514756 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.514846 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.515066 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.515162 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.515374 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.515462 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.515832 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.516148 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.516247 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.516464 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.516551 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.516804 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.517071 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.517163 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.517418 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.517517 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.517740 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.518023 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.518110 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.518361 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.518446 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.518678 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.518762 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.518996 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.519090 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.519319 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.519413 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.519641 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.519727 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.519961 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.520070 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.520273 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.520359 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.520587 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.520680 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.520894 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.520992 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.521234 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.521485 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.521710 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.521805 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.522106 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.522286 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.522425 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.522754 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.522840 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.523074 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.523372 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.523458 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.523687 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.523912 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.524005 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.524239 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.524378 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.524559 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.524674 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.524872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.524959 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.525209 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.525298 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.525515 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.525614 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.525837 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.525932 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.526145 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.526237 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.526452 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.526538 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.526758 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.526842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.527063 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.527155 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.527385 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.527472 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.527693 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.527778 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.528000 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.528085 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.528310 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.528396 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.528655 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.528740 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.528980 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.529091 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.529329 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.529415 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.529659 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.529746 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.529966 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.530082 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.530277 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.530393 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.530586 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.530702 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.530898 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.531029 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.531251 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.531534 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.531622 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.531881 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.532191 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.532276 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.532502 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.532595 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.532812 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.532924 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.533138 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.533476 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.533622 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.533920 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.534094 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.534220 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.534350 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.534546 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.534662 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.534851 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.534953 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.535159 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.535401 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.535507 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.535758 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.535846 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.536060 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.536160 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.536372 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.536457 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.536678 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.536765 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.536995 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.537117 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.537328 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.537421 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.537635 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.537729 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.537942 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.538037 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.538252 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.538338 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.538559 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.538651 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.538861 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.538959 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.539166 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.539259 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.539483 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.539567 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.539787 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.539873 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.540091 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.540176 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.540405 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.540491 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.540804 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.540983 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.541123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.541333 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.541597 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.541684 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.541960 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.542110 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.542449 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.542533 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.542768 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.543034 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.543129 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.543376 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.543545 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.543920 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.544024 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.544171 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.544461 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.544551 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.544819 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.544914 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.545253 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.545409 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.545590 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.545915 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.546000 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.546276 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.546475 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.546592 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.547051 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.547174 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.547602 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.547775 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.548097 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.548192 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.548415 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.548637 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.548723 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.549034 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.549168 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.549371 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.549683 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.549767 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.549999 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.550272 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.550369 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.550628 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.550882 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.550968 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.551242 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.551416 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.551553 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.551864 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.551949 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.552319 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.552508 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.552639 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.553006 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.553111 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.553344 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.553600 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.553698 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.553985 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.554110 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.554303 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.554619 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.554707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.554938 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.555165 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.555254 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.555606 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.555691 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.555949 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.556035 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.556278 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.556365 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.556604 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.556690 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.556926 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.557010 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.557283 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.557370 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.557597 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.557681 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.557914 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.557999 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.558241 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.558328 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.558572 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.558658 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.558882 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.558979 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.559199 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.559339 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.559508 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.559594 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.559821 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.559914 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.560131 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.560215 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.560445 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.560542 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.560757 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.560850 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.561088 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.561178 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.561405 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.561490 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.561718 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.561817 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.562031 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.562119 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.562341 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.562445 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.562816 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.562963 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.563139 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.563273 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.563633 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.563721 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.563952 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.564038 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.564268 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.564365 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.564580 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.564675 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.564892 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.565033 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.565241 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.565338 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.565523 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.565610 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.565831 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.565918 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.566140 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.566274 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.566582 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.566677 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.566892 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.566976 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.567198 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.567509 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.567821 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.568142 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.568600 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.568812 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.568936 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.569141 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.569304 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.569566 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.569666 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.569882 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.569972 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.570200 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.570289 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.570513 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.570610 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.570819 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.571015 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.571125 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.571358 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.571455 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.571662 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.571760 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.571987 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.572077 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.572304 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.572395 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.572618 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.572707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.572939 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.573028 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.573271 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.573362 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.573594 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.573682 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.573908 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.573995 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.574226 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.574335 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.574557 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.574645 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.574872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.575000 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.575202 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.575338 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.575604 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.575732 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.575926 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.576074 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.576235 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.576469 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.576604 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.576735 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.576869 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.577018 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.577170 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.577298 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.577480 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.577630 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.577804 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.577961 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.578239 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.578975 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.579381 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.579836 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.579922 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.580175 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.580271 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.580504 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.580602 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.580824 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.580910 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.581173 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.581349 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.581575 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.581660 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.581902 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.581988 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.582209 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.582303 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.582530 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.582623 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.582856 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.582948 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.583164 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.583260 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.583619 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.583731 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.583813 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.583990 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.584084 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.584370 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.584699 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.584784 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.585121 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.585230 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.585519 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.585670 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.585853 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.586187 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.586286 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.586504 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.586603 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.586817 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.586906 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.587136 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.587225 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.587447 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.587546 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.587761 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.587849 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.588090 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.588189 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.588403 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.588514 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.588720 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.588809 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.589038 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.589173 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.589372 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.589461 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.589680 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.589767 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.589987 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.590083 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.590294 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.590381 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.590601 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.590689 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.590912 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.591068 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.591299 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.591389 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.591630 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.591718 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.591956 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.592045 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.592268 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.592366 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.592595 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.592691 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.592909 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.593009 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.593244 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.593348 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.593555 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.593667 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.594117 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.594437 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.594586 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.594744 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.594879 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.595056 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.595511 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.595730 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.595877 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.596018 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.596157 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.596360 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.596497 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.596811 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.596947 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.597212 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.597391 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.597569 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.597738 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.597827 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.598066 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.598163 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.598391 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.598525 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.598721 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.598809 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.599031 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.599126 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.599344 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.599430 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.599660 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.599748 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.599967 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.600053 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.600272 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.600358 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.600576 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.600677 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.600887 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.600983 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.601219 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.601330 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.601574 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.601792 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.601884 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.602207 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.602292 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.602539 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.602836 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.602922 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.603251 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.603337 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.603585 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.603822 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.603909 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.604200 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.604411 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.604561 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.604775 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.605120 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.605231 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.605444 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.605760 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.605849 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.606098 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.606336 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.606433 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.606756 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.606915 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.607195 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.607301 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.607584 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.607813 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.607903 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.608289 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.608636 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.608746 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.608967 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.609346 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.609450 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.609872 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.610153 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.610404 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.610495 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.610811 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.610942 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.611140 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.611471 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.611568 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.611791 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.612012 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.612110 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.612426 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.612556 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.612751 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.613128 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.613349 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.613679 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.613768 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.613997 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.614218 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.614308 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.614616 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.614758 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.614935 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.615254 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.615348 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.615566 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.615848 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.615937 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.616188 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.616431 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.616528 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.616781 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.616985 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.617141 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.617352 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.617477 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.617690 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.617809 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.618037 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.618182 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.618367 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.618511 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.618692 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.618874 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.619029 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.619174 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.619452 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.619588 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.619776 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.619911 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.620095 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.620227 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.620412 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.620549 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.620737 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.620883 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.621087 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.621233 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.621380 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.621515 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.621684 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.621814 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.621998 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.622142 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.622313 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.622448 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.622641 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.622783 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.622979 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.623110 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.623303 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.623434 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.623620 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.623762 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.623937 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.624078 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.624256 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.624398 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.624627 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.624792 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.624931 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.625176 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.625611 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.625808 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.625946 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.626139 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.626277 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.626643 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.626727 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.626971 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.627304 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.627618 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.627929 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.628244 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.628559 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.628867 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.629217 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.629531 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.629839 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.630160 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.630471 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.631019 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.631367 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.631684 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.632013 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.632341 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.632657 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.632966 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.633313 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.633620 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.633926 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.634243 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.634553 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.634859 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.635167 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.635256 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.635478 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.635565 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.635787 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.635883 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.636093 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.636218 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.636403 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.636567 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.636711 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.636906 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.637038 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.637270 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.637356 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.637615 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.637726 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.637938 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.638025 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.638250 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.638334 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.638556 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.638651 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.638861 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.638990 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.639166 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.639260 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.639470 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.639565 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.639783 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.639869 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.640088 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.640182 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.640398 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.640493 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.640717 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.640811 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.641146 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.641283 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.641460 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.641640 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.641774 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.641966 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.642129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.642298 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.642455 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.642629 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.642763 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.642954 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.643068 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.643268 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.643390 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.643601 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.643686 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.643965 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.644060 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.644313 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.644407 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.644623 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.644755 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.644975 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.645128 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.645318 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.645407 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.645722 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.645966 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.646079 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.646310 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.646634 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.646762 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.646969 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.647185 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.647302 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.647611 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.647704 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.647919 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.648006 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.648227 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.648354 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.648552 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.648673 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.648864 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.648989 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.649200 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.649328 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.649514 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.649636 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.649826 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.649946 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.650136 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.650256 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.650445 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.650563 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.650760 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.650855 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.651068 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.651162 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.651375 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.651505 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.651686 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.651774 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.651992 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.652088 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.652301 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.652397 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.652608 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.652695 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.652925 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.653102 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.653296 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.653398 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.653615 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.653716 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.653933 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.654034 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.654249 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.654566 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.654678 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.654872 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.654961 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.655182 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.655292 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.655490 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.655579 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.655800 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.655905 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.656112 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.656271 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.656531 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.656630 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.656851 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.657263 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.657426 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.657761 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.657849 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.658084 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.658528 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.658631 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.658862 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.659139 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.659234 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.659462 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.659645 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.659856 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.659969 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.660182 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.660287 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.660491 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.660591 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.660799 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.660910 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.661127 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.661252 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.661438 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.661561 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.661746 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.661873 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.662049 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.662205 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.662355 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.662547 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.662663 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.662879 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.662968 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.663204 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.663303 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.663515 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.663604 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.663821 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.663919 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.664127 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.664229 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.664433 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.664522 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.664749 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.664837 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.665068 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.665161 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.665381 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.665478 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.665684 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.665783 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.665994 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.666085 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.666298 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.666387 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.666601 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.666698 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.666902 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.666990 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.667203 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.667300 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.667510 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.667599 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.667811 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.667899 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.668113 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.668202 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.668415 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.668517 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.668717 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.668834 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.669021 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.669194 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.669350 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.669505 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.669660 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.669821 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.669963 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.670125 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.670264 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.670442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.670573 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.670762 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.670860 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.671068 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.671157 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.671410 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.671516 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.671686 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.671808 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.672130 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.672229 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.672454 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.672619 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.672764 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.672949 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.673106 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.673296 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.673418 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.673602 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.673741 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.673906 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.674061 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.674212 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.674378 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.674518 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.674689 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.674833 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.675020 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.675139 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.675329 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.675425 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.675639 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.675728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.675949 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.676047 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.676257 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.676346 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.676566 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.676654 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.676871 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.676960 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.677208 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.677298 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.677514 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.677603 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.677811 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.677908 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.678111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.678208 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.678407 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.678505 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.678704 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.678792 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.679002 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.679091 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.679298 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.679450 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.679605 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.679720 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.679901 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.680000 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.680198 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.680311 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.680496 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.680591 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.680792 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.680887 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.681111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.681214 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.681441 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.681532 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.681764 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.681859 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.682072 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.682162 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.682392 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.682483 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.682700 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.682788 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.683015 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.683104 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.683321 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.683409 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.683638 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.683727 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.683956 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.684053 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.684270 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.684367 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.684574 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.684675 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.684900 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.684998 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.685239 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.685329 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.685547 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.685654 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.685789 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 07:04:16.685879 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.686144 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.686448 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.686754 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.687078 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.687419 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.687851 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.688200 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.688513 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.688829 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.689182 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.689493 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.689821 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.690126 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.690431 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.690742 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.691048 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.691357 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.691667 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.691976 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.692298 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.692619 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.692923 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.693633 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.693963 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.694307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.694618 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.694958 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.695281 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.695592 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.695899 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.696199 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:04:16.696440 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 07:04:16.747772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO dbcounter [None req-906826a4-c626-434e-9076-bca642021a9d None None] Registered counter for database nova_api Jul 12 07:04:16.757543 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO dbcounter [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Registered counter for database nova_api Jul 12 07:04:16.866457 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_db.sqlalchemy.engines [None req-906826a4-c626-434e-9076-bca642021a9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103469) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:04:16.873609 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG oslo_db.sqlalchemy.engines [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:04:16.874163 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writer thread running {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:04:16.880360 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writer thread running {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:04:16.931028 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.context [None req-906826a4-c626-434e-9076-bca642021a9d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e119ac6-6b57-4f90-ba6d-28f92a02395b(cell1) {{(pid=103469) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 07:04:16.934944 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-906826a4-c626-434e-9076-bca642021a9d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:04:16.935600 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.context [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e119ac6-6b57-4f90-ba6d-28f92a02395b(cell1) {{(pid=103468) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 07:04:16.936533 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-906826a4-c626-434e-9076-bca642021a9d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:04:16.937362 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-906826a4-c626-434e-9076-bca642021a9d None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:04:16.939490 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-906826a4-c626-434e-9076-bca642021a9d None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:04:16.939626 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG oslo_concurrency.lockutils [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:04:16.941159 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG oslo_concurrency.lockutils [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:04:16.941513 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO dbcounter [None req-906826a4-c626-434e-9076-bca642021a9d None None] Registered counter for database nova_cell0 Jul 12 07:04:16.941933 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG oslo_concurrency.lockutils [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:04:16.944356 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG oslo_concurrency.lockutils [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:04:16.945880 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO dbcounter [None req-906826a4-c626-434e-9076-bca642021a9d None None] Registered counter for database nova_cell1 Jul 12 07:04:16.946623 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO dbcounter [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Registered counter for database nova_cell0 Jul 12 07:04:16.950434 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO dbcounter [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Registered counter for database nova_cell1 Jul 12 07:04:16.954182 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_db.sqlalchemy.engines [None req-906826a4-c626-434e-9076-bca642021a9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103469) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:04:16.956861 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_db.sqlalchemy.engines [None req-906826a4-c626-434e-9076-bca642021a9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103469) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:04:16.958524 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG oslo_db.sqlalchemy.engines [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:04:16.961635 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG oslo_db.sqlalchemy.engines [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:04:16.961758 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writer thread running {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:04:16.964936 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writer thread running {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:04:16.971006 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writer thread running {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:04:17.100458 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writer thread running {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:04:17.110934 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO dbcounter [None req-906826a4-c626-434e-9076-bca642021a9d None None] Registered counter for database nova_cell0 Jul 12 07:04:17.115997 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO dbcounter [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Registered counter for database nova_cell0 Jul 12 07:04:17.120428 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_db.sqlalchemy.engines [None req-906826a4-c626-434e-9076-bca642021a9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103469) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:04:17.125325 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writer thread running {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:04:17.125465 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG oslo_db.sqlalchemy.engines [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:04:17.130962 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writer thread running {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:04:17.456367 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: WARNING keystonemiddleware.auth_token [None req-906826a4-c626-434e-9076-bca642021a9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 07:04:17.460509 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: WARNING keystonemiddleware.auth_token [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 07:04:17.463765 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: WARNING keystonemiddleware.auth_token [None req-906826a4-c626-434e-9076-bca642021a9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 07:04:17.467884 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: WARNING keystonemiddleware.auth_token [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 07:04:17.803152 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: WARNING keystonemiddleware.auth_token [None req-906826a4-c626-434e-9076-bca642021a9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 07:04:17.809093 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: WARNING keystonemiddleware.auth_token [None req-906826a4-c626-434e-9076-bca642021a9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 07:04:17.814495 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad813729c0 pid: 103469 (default app) Jul 12 07:04:17.816567 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-906826a4-c626-434e-9076-bca642021a9d None None] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:04:17.817788 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-906826a4-c626-434e-9076-bca642021a9d None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001765 Jul 12 07:04:17.818558 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue Jul 12 07:04:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:04:17.821086 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: WARNING keystonemiddleware.auth_token [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 07:04:17.827162 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: WARNING keystonemiddleware.auth_token [None req-e3140993-865a-45a8-a0ba-912ee7deefe0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 07:04:17.832578 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad813729c0 pid: 103468 (default app) Jul 12 07:05:34.226676 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-906826a4-c626-434e-9076-bca642021a9d None None] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:34.228003 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-906826a4-c626-434e-9076-bca642021a9d None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Jul 12 07:05:34.228692 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:05:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:05:34.247404 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writing DB stats nova_api:SELECT=3 {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:05:34.249188 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writing DB stats nova_cell0:SELECT=3 {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:05:34.250050 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writing DB stats nova_cell1:SELECT=3 {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:05:34.250825 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:05:35.100856 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-e415258b-59ae-418a-ab74-86a81f07021b admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:35.130497 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-e415258b-59ae-418a-ab74-86a81f07021b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893887 Jul 12 07:05:35.131410 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 12 07:05:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:05:37.397241 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-906826a4-c626-434e-9076-bca642021a9d None None] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:37.398251 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-906826a4-c626-434e-9076-bca642021a9d None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 12 07:05:37.398697 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:05:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:05:37.886811 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-59804d88-8e03-48bd-98bc-245e1d573c2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:37.905056 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:05:37.905056 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: warnings.warn(msg) Jul 12 07:05:37.933848 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-59804d88-8e03-48bd-98bc-245e1d573c2e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528908 Jul 12 07:05:37.934546 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:05:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 07:05:37.948547 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_api:SELECT=3 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:05:37.949369 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_cell1:SELECT=3 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:05:37.950323 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_cell0:SELECT=3 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:05:37.951170 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:05:38.175708 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-75f0b124-f28d-45eb-92ba-f291be4ca320 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:38.178190 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:05:38.178190 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: warnings.warn(msg) Jul 12 07:05:38.246547 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-75f0b124-f28d-45eb-92ba-f291be4ca320 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.303236 Jul 12 07:05:38.247507 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 07:05:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:05:40.462442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-59804d88-8e03-48bd-98bc-245e1d573c2e admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:40.463469 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-59804d88-8e03-48bd-98bc-245e1d573c2e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 12 07:05:40.463866 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:05:41.118184 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-79fb9bd7-d6bf-44b1-ab1c-ffb4196aa7a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:41.136679 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:05:41.136679 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: warnings.warn(msg) Jul 12 07:05:41.159876 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-79fb9bd7-d6bf-44b1-ab1c-ffb4196aa7a5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689795 Jul 12 07:05:41.167714 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:05:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:05:41.173014 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-bc8906dc-531f-462d-8eaf-e02df44ec234 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:41.174698 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:05:41.174698 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: warnings.warn(msg) Jul 12 07:05:41.214539 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-bc8906dc-531f-462d-8eaf-e02df44ec234 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045538 Jul 12 07:05:41.215555 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 07:05:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:05:43.497964 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-79fb9bd7-d6bf-44b1-ab1c-ffb4196aa7a5 admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:43.498999 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-79fb9bd7-d6bf-44b1-ab1c-ffb4196aa7a5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Jul 12 07:05:43.499407 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:05:43.899430 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-47c63511-acd4-481f-9b4b-8917f7096028 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:43.918267 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-47c63511-acd4-481f-9b4b-8917f7096028 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413062 Jul 12 07:05:43.918802 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:05:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:05:43.931204 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-31464c73-abae-4cf7-bfcb-21aa70c3c85b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:43.955341 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-31464c73-abae-4cf7-bfcb-21aa70c3c85b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027917 Jul 12 07:05:43.956026 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 07:05:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:05:46.194248 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-47c63511-acd4-481f-9b4b-8917f7096028 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:46.195270 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-47c63511-acd4-481f-9b4b-8917f7096028 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 12 07:05:46.195873 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:05:46.679321 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-858e2e6e-4dec-4fe8-8e49-8b36f57d746e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "ram": 2048}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:46.705010 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-858e2e6e-4dec-4fe8-8e49-8b36f57d746e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503444 Jul 12 07:05:46.705960 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:05:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:05:46.718648 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-d6859e2d-31f8-405c-ad8b-5c91db811854 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:46.742459 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-d6859e2d-31f8-405c-ad8b-5c91db811854 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027907 Jul 12 07:05:46.743033 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 07:05:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:05:48.955379 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-858e2e6e-4dec-4fe8-8e49-8b36f57d746e admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:48.956394 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-858e2e6e-4dec-4fe8-8e49-8b36f57d746e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 12 07:05:48.956777 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:05:49.371501 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-c2406d7c-2700-479a-9b13-737ee085407f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:49.391039 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-c2406d7c-2700-479a-9b13-737ee085407f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428260 Jul 12 07:05:49.392105 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:05:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:05:49.404164 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-e33e7dfd-a5f4-49be-bddc-c38f7c5656dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:49.431746 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-e33e7dfd-a5f4-49be-bddc-c38f7c5656dc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031425 Jul 12 07:05:49.433618 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 07:05:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:05:51.805454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-c2406d7c-2700-479a-9b13-737ee085407f admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:51.806442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-c2406d7c-2700-479a-9b13-737ee085407f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Jul 12 07:05:51.806873 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:05:52.276711 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-196dc338-0ca1-418d-951f-d6f5d801a55b admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:52.301942 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-196dc338-0ca1-418d-951f-d6f5d801a55b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.487903 Jul 12 07:05:52.302517 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 12 07:05:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:05:55.166394 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-c2406d7c-2700-479a-9b13-737ee085407f admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:55.167883 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-c2406d7c-2700-479a-9b13-737ee085407f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Jul 12 07:05:55.168625 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:05:55.662199 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-e67ae5aa-246d-4ec0-ab8c-253e9fc28160 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:55.681476 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-e67ae5aa-246d-4ec0-ab8c-253e9fc28160 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.506386 Jul 12 07:05:55.682056 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:05:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:05:55.696987 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-a50142b8-e339-4a6c-9861-ba78104585d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:55.726400 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-a50142b8-e339-4a6c-9861-ba78104585d2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034407 Jul 12 07:05:55.727379 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 07:05:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:05:57.923263 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-e67ae5aa-246d-4ec0-ab8c-253e9fc28160 admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:05:57.924237 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-e67ae5aa-246d-4ec0-ab8c-253e9fc28160 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 12 07:05:57.924670 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:05:58.346356 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-396db296-e925-44b8-88fd-b2f37ac7ba83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:58.364993 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-396db296-e925-44b8-88fd-b2f37ac7ba83 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434165 Jul 12 07:05:58.365611 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:05:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:05:58.380553 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-d4596b47-ef49-4309-8266-9dac3257ca81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:05:58.404917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-d4596b47-ef49-4309-8266-9dac3257ca81 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030742 Jul 12 07:05:58.405912 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 07:05:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:00.637218 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-396db296-e925-44b8-88fd-b2f37ac7ba83 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:00.638561 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-396db296-e925-44b8-88fd-b2f37ac7ba83 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002177 Jul 12 07:06:00.638933 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:01.065367 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-be773e52-3c73-4cc0-9e30-5da2330ede89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:01.085242 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-be773e52-3c73-4cc0-9e30-5da2330ede89 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.439803 Jul 12 07:06:01.085901 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:06:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:06:01.098098 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-b864c66c-bdf3-482a-b92f-bd7ff0222710 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:01.125017 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-b864c66c-bdf3-482a-b92f-bd7ff0222710 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030605 Jul 12 07:06:01.125646 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 07:06:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:03.349855 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-be773e52-3c73-4cc0-9e30-5da2330ede89 admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:03.350879 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-be773e52-3c73-4cc0-9e30-5da2330ede89 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 12 07:06:03.351279 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:06:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:03.787149 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-8f227ed9-e140-4ba4-a655-209bc95b6166 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:03.805726 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-8f227ed9-e140-4ba4-a655-209bc95b6166 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448654 Jul 12 07:06:03.806482 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:06:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:06:03.819333 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-42a1a3d9-180f-4616-a88e-411956c26cb5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:03.843917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-42a1a3d9-180f-4616-a88e-411956c26cb5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028533 Jul 12 07:06:03.857638 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 07:06:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:06.123672 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-8f227ed9-e140-4ba4-a655-209bc95b6166 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:06.124610 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-8f227ed9-e140-4ba4-a655-209bc95b6166 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 12 07:06:06.125009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:06.584948 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-342466a6-8fcf-41a9-86c8-9652b2f8a4de admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:06.609367 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-342466a6-8fcf-41a9-86c8-9652b2f8a4de admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.478250 Jul 12 07:06:06.609928 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 07:06:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 07:06:06.621794 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-1536d3ea-e663-4960-956e-55028d87060f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:06.625674 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:06.651278 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-1536d3ea-e663-4960-956e-55028d87060f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033197 Jul 12 07:06:06.664910 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 07:06:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:25.944102 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-342466a6-8fcf-41a9-86c8-9652b2f8a4de admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:25.945170 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-342466a6-8fcf-41a9-86c8-9652b2f8a4de admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 12 07:06:25.945570 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:26.366705 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-8012c533-1705-4c7d-815b-5a8ffe2df7b5 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:26.383537 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-8012c533-1705-4c7d-815b-5a8ffe2df7b5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.431768 Jul 12 07:06:26.384060 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 12 07:06:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:06:27.469675 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-342466a6-8fcf-41a9-86c8-9652b2f8a4de admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:27.471221 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-342466a6-8fcf-41a9-86c8-9652b2f8a4de admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002236 Jul 12 07:06:27.471861 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:28.020654 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-0343d284-23b9-4dac-b2fd-f06724f39076 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:28.026258 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.wsgi [None req-0343d284-23b9-4dac-b2fd-f06724f39076 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-0343d284-23b9-4dac-b2fd-f06724f39076 admin admin] Request method failure captured: Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Accept: application/json Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Accept-Encoding: gzip, deflate Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Connection: keep-alive Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Content-Length: 0 Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Host: 10.222.0.25 Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Openstack-Api-Version: compute 2.90 Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Openstack-System-Scope: None Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: User-Agent: python-novaclient Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Auth-Token: gAAAAABizR1z-fbyUx7nVd6QxSI5GEqxaEo-XN5Nmd3AlOlwCrdKu-28v1Cv9SbV2VVnMa2Ivsg0iV0tNgDR7ekzE39hER-izuxwQFwW2VV3PLKIZVnJVBamXh_IvpNVsgak9hYJyCkLqT40VggqbWVwnqdPnpzW6x5_WtCDwHj_ZA4p4Rd38Ww Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Domain-Id: None Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Domain-Name: None Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Identity-Status: Confirmed Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Is-Admin-Project: True Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Domain-Id: default Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Domain-Name: Default Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Name: admin Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Role: member,reader,admin Jul 12 07:06:28.029576 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Roles: member,reader,admin Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91c604937dd14031814263870ccac629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91c604937dd14031814263870ccac629"}]}] Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Tenant: admin Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Tenant-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Tenant-Name: admin Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User: admin Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Domain-Id: default Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Domain-Name: Default Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Id: 3921c7a7e4fd41ef9eea262b7a97405a Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Name: admin Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: method: > Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: exception: Flavor 42 could not be found. Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: action_args: {'id': '42'} Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:06:28.031009 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:28.031913 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.033111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-0343d284-23b9-4dac-b2fd-f06724f39076 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:06:28.034383 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-0343d284-23b9-4dac-b2fd-f06724f39076 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.423129 Jul 12 07:06:28.034383 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 12 07:06:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 07:06:28.040850 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-ce6d81c3-a4ed-42ea-af22-e520ca9be666 admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:28.044054 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:28.063061 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-ce6d81c3-a4ed-42ea-af22-e520ca9be666 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025899 Jul 12 07:06:28.063953 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 07:06:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:06:28.074188 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-7759727d-909e-4255-8ae4-26ccb11df71b admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:28.095535 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-7759727d-909e-4255-8ae4-26ccb11df71b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025201 Jul 12 07:06:28.096120 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 07:06:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:06:28.106059 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-13b5f163-cb66-458e-b500-19f507d4ce82 admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:28.111860 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.wsgi [None req-13b5f163-cb66-458e-b500-19f507d4ce82 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-13b5f163-cb66-458e-b500-19f507d4ce82 admin admin] Request method failure captured: Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Accept: application/json Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Accept-Encoding: gzip, deflate Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Connection: keep-alive Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Content-Length: 0 Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Host: 10.222.0.25 Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Openstack-Api-Version: compute 2.90 Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Openstack-System-Scope: None Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: User-Agent: python-novaclient Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Auth-Token: gAAAAABizR1z-fbyUx7nVd6QxSI5GEqxaEo-XN5Nmd3AlOlwCrdKu-28v1Cv9SbV2VVnMa2Ivsg0iV0tNgDR7ekzE39hER-izuxwQFwW2VV3PLKIZVnJVBamXh_IvpNVsgak9hYJyCkLqT40VggqbWVwnqdPnpzW6x5_WtCDwHj_ZA4p4Rd38Ww Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Domain-Id: None Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Domain-Name: None Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Identity-Status: Confirmed Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Is-Admin-Project: True Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Domain-Id: default Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Domain-Name: Default Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Name: admin Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Role: member,reader,admin Jul 12 07:06:28.115253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Roles: member,reader,admin Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91c604937dd14031814263870ccac629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91c604937dd14031814263870ccac629"}]}] Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Tenant: admin Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Tenant-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Tenant-Name: admin Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User: admin Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Domain-Id: default Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Domain-Name: Default Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Id: 3921c7a7e4fd41ef9eea262b7a97405a Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Name: admin Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: method: > Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: exception: Flavor 42 could not be found. Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: action_args: {'id': '42'} Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:06:28.116707 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:28.117772 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:28.119129 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-13b5f163-cb66-458e-b500-19f507d4ce82 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103469) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:06:28.120466 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-13b5f163-cb66-458e-b500-19f507d4ce82 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014545 Jul 12 07:06:28.120466 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 12 07:06:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 07:06:29.088594 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-7759727d-909e-4255-8ae4-26ccb11df71b admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:29.089916 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-7759727d-909e-4255-8ae4-26ccb11df71b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001776 Jul 12 07:06:29.090321 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:29.657771 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-a2c7b906-4cb8-4195-8005-dad35645585b admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:29.663166 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.wsgi [None req-a2c7b906-4cb8-4195-8005-dad35645585b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-a2c7b906-4cb8-4195-8005-dad35645585b admin admin] Request method failure captured: Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Accept: application/json Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Accept-Encoding: gzip, deflate Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Connection: keep-alive Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Content-Length: 0 Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Host: 10.222.0.25 Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Openstack-Api-Version: compute 2.90 Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Openstack-System-Scope: None Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: User-Agent: python-novaclient Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Auth-Token: gAAAAABizR10M39NIDjOmDm2rRXrIxHReiEPcg8AX_UlVie7Y2h76UTmHAp1HWuEwX2fU3KWEWQ1uzxiHdR3ivA0iuVdR83n-pfncn-ke5IGW2nc4Dkq2S90icEeZeTIdRMmPDboupEAoZ2EdGLrhwLNne_tnyas0R0gGLqSgOODOuolfRYD81k Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Domain-Id: None Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Domain-Name: None Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Identity-Status: Confirmed Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Is-Admin-Project: True Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Domain-Id: default Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Domain-Name: Default Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Name: admin Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Role: member,reader,admin Jul 12 07:06:29.664701 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Roles: member,reader,admin Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91c604937dd14031814263870ccac629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91c604937dd14031814263870ccac629"}]}] Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Tenant: admin Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Tenant-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Tenant-Name: admin Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User: admin Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Domain-Id: default Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Domain-Name: Default Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Id: 3921c7a7e4fd41ef9eea262b7a97405a Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Name: admin Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: method: > Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: exception: Flavor 84 could not be found. Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: action_args: {'id': '84'} Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:06:29.666123 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:29.666917 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.668161 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-a2c7b906-4cb8-4195-8005-dad35645585b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103469) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:06:29.669519 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-a2c7b906-4cb8-4195-8005-dad35645585b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.421676 Jul 12 07:06:29.669519 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 12 07:06:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 07:06:29.676292 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-ae296252-6d7f-4a41-bcae-81c692dec9f3 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:29.690591 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-ae296252-6d7f-4a41-bcae-81c692dec9f3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017997 Jul 12 07:06:29.691130 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 07:06:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:06:29.701687 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-f68f1cc1-808b-4f41-b3bb-62038daa4ebb admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:29.715841 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-f68f1cc1-808b-4f41-b3bb-62038daa4ebb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018096 Jul 12 07:06:29.716145 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 07:06:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:06:29.725458 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-d0b5b679-4c31-4f82-b6e6-6b78a982b518 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:29.731363 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.wsgi [None req-d0b5b679-4c31-4f82-b6e6-6b78a982b518 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-d0b5b679-4c31-4f82-b6e6-6b78a982b518 admin admin] Request method failure captured: Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Accept: application/json Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Accept-Encoding: gzip, deflate Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Connection: keep-alive Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Content-Length: 0 Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Host: 10.222.0.25 Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Openstack-Api-Version: compute 2.90 Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Openstack-System-Scope: None Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: User-Agent: python-novaclient Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Auth-Token: gAAAAABizR10M39NIDjOmDm2rRXrIxHReiEPcg8AX_UlVie7Y2h76UTmHAp1HWuEwX2fU3KWEWQ1uzxiHdR3ivA0iuVdR83n-pfncn-ke5IGW2nc4Dkq2S90icEeZeTIdRMmPDboupEAoZ2EdGLrhwLNne_tnyas0R0gGLqSgOODOuolfRYD81k Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Domain-Id: None Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Domain-Name: None Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Identity-Status: Confirmed Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Is-Admin-Project: True Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Domain-Id: default Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Domain-Name: Default Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Name: admin Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Role: member,reader,admin Jul 12 07:06:29.732872 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Roles: member,reader,admin Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91c604937dd14031814263870ccac629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91c604937dd14031814263870ccac629"}]}] Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Tenant: admin Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Tenant-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Tenant-Name: admin Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User: admin Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Domain-Id: default Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Domain-Name: Default Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Id: 3921c7a7e4fd41ef9eea262b7a97405a Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Name: admin Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: method: > Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: exception: Flavor 84 could not be found. Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: action_args: {'id': '84'} Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:06:29.734442 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:29.737925 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:29.739224 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-d0b5b679-4c31-4f82-b6e6-6b78a982b518 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:06:29.740486 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-d0b5b679-4c31-4f82-b6e6-6b78a982b518 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012387 Jul 12 07:06:29.740486 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 12 07:06:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 07:06:30.701771 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-f68f1cc1-808b-4f41-b3bb-62038daa4ebb admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:30.703439 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-f68f1cc1-808b-4f41-b3bb-62038daa4ebb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002362 Jul 12 07:06:30.704078 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:06:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:31.289219 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-9960826a-eb94-4d70-aa8e-fbb788e0959f admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:31.296294 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.wsgi [None req-9960826a-eb94-4d70-aa8e-fbb788e0959f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-9960826a-eb94-4d70-aa8e-fbb788e0959f admin admin] Request method failure captured: Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Accept: application/json Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Accept-Encoding: gzip, deflate Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Connection: keep-alive Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Content-Length: 0 Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Host: 10.222.0.25 Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Openstack-Api-Version: compute 2.90 Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Openstack-System-Scope: None Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: User-Agent: python-novaclient Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Auth-Token: gAAAAABizR12x4B2Yf6RMtLcnmJqQgXamp_bZOA-qgnmHx5l77h9R_igTH2CJ2Pb4D5zgtGc6YcZVCe9bZK2xPx2IsZHvo9CTvCykh3LWendMqc6iYPoqYNC37X4k1Ur5meKZMffEPFlm2NKN-kFMuusKJs29UVBTR60YG2-DuNY3gZ_NZjIfcU Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Domain-Id: None Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Domain-Name: None Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Identity-Status: Confirmed Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Is-Admin-Project: True Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Domain-Id: default Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Domain-Name: Default Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Project-Name: admin Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Role: member,reader,admin Jul 12 07:06:31.297852 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Roles: member,reader,admin Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91c604937dd14031814263870ccac629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91c604937dd14031814263870ccac629"}]}] Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Tenant: admin Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Tenant-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-Tenant-Name: admin Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User: admin Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Domain-Id: default Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Domain-Name: Default Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Id: 3921c7a7e4fd41ef9eea262b7a97405a Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: X-User-Name: admin Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: method: > Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: exception: Flavor 451 could not be found. Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: action_args: {'id': '451'} Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:06:31.299454 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:31.300307 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.301728 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-9960826a-eb94-4d70-aa8e-fbb788e0959f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:06:31.302972 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-9960826a-eb94-4d70-aa8e-fbb788e0959f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.447294 Jul 12 07:06:31.302972 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 07:06:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 07:06:31.309541 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-f9f31259-b618-4b04-ae2c-ca0bb5ed7a3c admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:31.324087 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-f9f31259-b618-4b04-ae2c-ca0bb5ed7a3c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018266 Jul 12 07:06:31.324644 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 07:06:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:06:31.334111 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:31.349244 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018623 Jul 12 07:06:31.349770 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 07:06:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:06:31.360253 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-2dc30cc8-a139-454e-ac19-01a99df41fef admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:31.365688 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.wsgi [None req-2dc30cc8-a139-454e-ac19-01a99df41fef admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-2dc30cc8-a139-454e-ac19-01a99df41fef admin admin] Request method failure captured: Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Accept: application/json Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Accept-Encoding: gzip, deflate Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Connection: keep-alive Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Content-Length: 0 Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Host: 10.222.0.25 Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Openstack-Api-Version: compute 2.90 Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Openstack-System-Scope: None Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: User-Agent: python-novaclient Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Auth-Token: gAAAAABizR12x4B2Yf6RMtLcnmJqQgXamp_bZOA-qgnmHx5l77h9R_igTH2CJ2Pb4D5zgtGc6YcZVCe9bZK2xPx2IsZHvo9CTvCykh3LWendMqc6iYPoqYNC37X4k1Ur5meKZMffEPFlm2NKN-kFMuusKJs29UVBTR60YG2-DuNY3gZ_NZjIfcU Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Domain-Id: None Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Domain-Name: None Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Identity-Status: Confirmed Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Is-Admin-Project: True Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Domain-Id: default Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Domain-Name: Default Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Project-Name: admin Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Role: member,reader,admin Jul 12 07:06:31.367197 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Roles: member,reader,admin Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/91c604937dd14031814263870ccac629"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_91c604937dd14031814263870ccac629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/91c604937dd14031814263870ccac629"}]}] Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Tenant: admin Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Tenant-Id: 91c604937dd14031814263870ccac629 Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-Tenant-Name: admin Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User: admin Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Domain-Id: default Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Domain-Name: Default Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Id: 3921c7a7e4fd41ef9eea262b7a97405a Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: X-User-Name: admin Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: method: > Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: exception: Flavor 451 could not be found. Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: action_args: {'id': '451'} Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:06:31.368842 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:31.369893 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: ERROR nova.api.openstack.wsgi Jul 12 07:06:31.371017 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-2dc30cc8-a139-454e-ac19-01a99df41fef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103469) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:06:31.372016 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-2dc30cc8-a139-454e-ac19-01a99df41fef admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012270 Jul 12 07:06:31.372016 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 07:06:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 07:06:32.364851 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:32.366132 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Jul 12 07:06:32.366535 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:06:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:32.945353 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-35520be4-c2b1-4738-8faa-b12c3d8b251b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:32.965761 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-35520be4-c2b1-4738-8faa-b12c3d8b251b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.462619 Jul 12 07:06:32.966323 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 12 07:06:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:06:33.954537 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:33.955549 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 12 07:06:33.955937 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:34.551224 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-33c13513-22c5-4284-b740-080ca3542b96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:34.569931 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-33c13513-22c5-4284-b740-080ca3542b96 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.476404 Jul 12 07:06:34.570491 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 12 07:06:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:06:35.566854 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:35.567854 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 12 07:06:35.568215 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:36.147049 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-f9ac1681-b059-4e67-bb2d-4b0f299b02c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:36.167652 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-f9ac1681-b059-4e67-bb2d-4b0f299b02c7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.454243 Jul 12 07:06:36.168219 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 12 07:06:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:06:37.156688 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:37.158291 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002201 Jul 12 07:06:37.158860 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:37.757400 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-b4ee26f6-de2c-4171-ab26-fc7d155a178b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:06:37.781294 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-b4ee26f6-de2c-4171-ab26-fc7d155a178b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.458227 Jul 12 07:06:37.781846 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 12 07:06:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:06:38.754919 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:38.755940 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 12 07:06:38.756326 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:06:39.335610 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-101ffe95-dcf6-4c49-87ba-cf49bd03c8d7 admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:06:39.355746 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-101ffe95-dcf6-4c49-87ba-cf49bd03c8d7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.462419 Jul 12 07:06:39.356498 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Jul 12 07:06:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:07:31.953385 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:07:31.955008 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-4424d4ed-8623-463c-b300-210a5e2b7007 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002332 Jul 12 07:07:31.955637 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 07:07:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:07:31.972327 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.386296 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-e51ca6ad-36d3-48d0-9601-2161c2120e8d admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:07:32.405290 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-e51ca6ad-36d3-48d0-9601-2161c2120e8d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.440112 Jul 12 07:07:32.405829 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 12 07:07:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:07:32.427760 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG dbcounter [-] [103468] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.433631 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-27839c65-514c-4d85-a632-3ef71950f2b6 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:07:32.446223 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-27839c65-514c-4d85-a632-3ef71950f2b6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020539 Jul 12 07:07:32.446938 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Tue Jul 12 07:07:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:32.458813 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-f89a516b-6872-484c-9d69-062e025dc896 admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:07:32.466624 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-f89a516b-6872-484c-9d69-062e025dc896 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011381 Jul 12 07:07:32.467121 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Tue Jul 12 07:07:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:32.478832 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:07:32.487924 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012891 Jul 12 07:07:32.488416 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Tue Jul 12 07:07:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:32.503943 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-61945f9b-d3be-4857-98b2-893cc11d24ba admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:07:32.512241 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-61945f9b-d3be-4857-98b2-893cc11d24ba admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011850 Jul 12 07:07:32.512702 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Tue Jul 12 07:07:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:10:59.394409 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:10:59.396077 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002396 Jul 12 07:10:59.396750 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:10:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:10:59.544623 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_api:SELECT=6 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:59.709520 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-6a52deac-4912-49c3-b25f-47021b414d34 admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:10:59.710684 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:10:59.710684 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: warnings.warn(msg) Jul 12 07:10:59.711866 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-6a52deac-4912-49c3-b25f-47021b414d34 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:10:59.712304 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-6a52deac-4912-49c3-b25f-47021b414d34 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:10:59.713126 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-6a52deac-4912-49c3-b25f-47021b414d34 admin admin] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:10:59.713548 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-6a52deac-4912-49c3-b25f-47021b414d34 admin admin] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:10:59.747348 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-6a52deac-4912-49c3-b25f-47021b414d34 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.208060 Jul 12 07:10:59.748098 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 07:10:59 2022] GET /compute/v2.1/os-services => generated 794 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:11:00.585274 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:11:00.586327 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 12 07:11:00.586758 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:11:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:11:00.795851 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-35245956-3666-431b-9205-f77e71ceb86c admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:11:00.797256 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:11:00.797256 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: warnings.warn(msg) Jul 12 07:11:00.798966 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-35245956-3666-431b-9205-f77e71ceb86c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:11:00.799579 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-35245956-3666-431b-9205-f77e71ceb86c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:11:00.800752 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-35245956-3666-431b-9205-f77e71ceb86c admin admin] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:11:00.801302 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-35245956-3666-431b-9205-f77e71ceb86c admin admin] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:11:00.827239 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-35245956-3666-431b-9205-f77e71ceb86c admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.102749 Jul 12 07:11:00.827815 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 07:11:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:11:12.101885 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:11:12.102903 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 12 07:11:12.103330 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:11:12.248495 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_cell0:SELECT=4 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:12.249318 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_cell1:SELECT=4 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:12.249840 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG dbcounter [-] [103469] Writing DB stats nova_api:SELECT=8 {{(pid=103469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:12.303993 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-3c78a7db-190f-4a93-a3cf-e241576e2032 admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:11:12.305189 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:11:12.305189 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: warnings.warn(msg) Jul 12 07:11:12.306366 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-3c78a7db-190f-4a93-a3cf-e241576e2032 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:11:12.306805 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-3c78a7db-190f-4a93-a3cf-e241576e2032 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:11:12.307583 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-3c78a7db-190f-4a93-a3cf-e241576e2032 admin admin] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:11:12.308011 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-3c78a7db-190f-4a93-a3cf-e241576e2032 admin admin] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:11:12.332727 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-3c78a7db-190f-4a93-a3cf-e241576e2032 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.092072 Jul 12 07:11:12.333328 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 07:11:12 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:11:13.172824 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: DEBUG nova.api.openstack.wsgi [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] Calling method '>' {{(pid=103468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:11:13.174440 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: INFO nova.api.openstack.requestlog [None req-ee9bec90-9b23-4bbf-a401-a37ecb7913e6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Jul 12 07:11:13.174812 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: [pid: 103468|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 07:11:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:11:13.379743 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG nova.api.openstack.wsgi [None req-da78f020-bc52-4655-927f-f82139e8832d admin admin] Calling method '>' {{(pid=103469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:11:13.380903 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:11:13.380903 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: warnings.warn(msg) Jul 12 07:11:13.382098 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-da78f020-bc52-4655-927f-f82139e8832d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:11:13.382528 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-da78f020-bc52-4655-927f-f82139e8832d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:11:13.383300 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-da78f020-bc52-4655-927f-f82139e8832d admin admin] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:11:13.383723 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: DEBUG oslo_concurrency.lockutils [None req-da78f020-bc52-4655-927f-f82139e8832d admin admin] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:11:13.407731 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: INFO nova.api.openstack.requestlog [None req-da78f020-bc52-4655-927f-f82139e8832d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.093424 Jul 12 07:11:13.408586 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: [pid: 103469|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 07:11:13 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:12:09.194952 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: Tue Jul 12 07:12:09 2022 - graceful shutdown triggered... Jul 12 07:12:09.195048 dv-cinder-825492-25-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 07:12:09.196081 dv-cinder-825492-25-iscsi devstack@n-api.service[103468]: Gracefully killing worker 1 (pid: 103468)... Jul 12 07:12:09.196560 dv-cinder-825492-25-iscsi devstack@n-api.service[103469]: Gracefully killing worker 2 (pid: 103469)... Jul 12 07:12:10.197349 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: worker 1 buried after 1 seconds Jul 12 07:12:10.197349 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: worker 2 buried after 1 seconds Jul 12 07:12:10.197349 dv-cinder-825492-25-iscsi devstack@n-api.service[103467]: goodbye to uWSGI. Jul 12 07:12:10.199883 dv-cinder-825492-25-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 07:12:10.200833 dv-cinder-825492-25-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 07:12:10.205472 dv-cinder-825492-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 07:12:10.216809 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 07:12:10 2022] *** Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: nodename: dv-cinder-825492-25-iscsi Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: machine: x86_64 Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: clock source: unix Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: pcre jit disabled Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: detected number of CPU cores: 4 Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: current working directory: / Jul 12 07:12:10.218776 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: detected binary path: /usr/bin/uwsgi-core Jul 12 07:12:10.219539 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: your processes number limit is 47680 Jul 12 07:12:10.219539 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: your memory page size is 4096 bytes Jul 12 07:12:10.219539 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: detected max file descriptor number: 2048 Jul 12 07:12:10.219539 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: lock engine: pthread robust mutexes Jul 12 07:12:10.219539 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: thunder lock: enabled Jul 12 07:12:10.219539 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 07:12:10.219539 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 07:12:10.266304 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: Python main interpreter initialized at 0x557c0e6499c0 Jul 12 07:12:10.266304 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: python threads support enabled Jul 12 07:12:10.266304 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: your server socket listen backlog is limited to 100 connections Jul 12 07:12:10.266304 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: your mercy for graceful operations on workers is 90 seconds Jul 12 07:12:10.266792 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 07:12:10.266792 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: *** Operational MODE: preforking *** Jul 12 07:12:10.267054 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: *** uWSGI is running in multiple interpreter mode *** Jul 12 07:12:10.267054 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: spawned uWSGI master process (pid: 117981) Jul 12 07:12:10.267249 dv-cinder-825492-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 07:12:10.267809 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: spawned uWSGI worker 1 (pid: 117997, cores: 1) Jul 12 07:12:10.268173 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: spawned uWSGI worker 2 (pid: 117998, cores: 1) Jul 12 07:12:10.268316 dv-cinder-825492-25-iscsi devstack@n-api.service[117981]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 07:12:10.930618 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 07:12:10.932751 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 07:12:12.106309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:12:12.106309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: from cryptography.utils import int_from_bytes Jul 12 07:12:12.107696 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:12:12.107696 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: from cryptography.utils import int_from_bytes Jul 12 07:12:12.123325 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:12:12.123325 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: from cryptography.utils import int_from_bytes Jul 12 07:12:12.123917 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:12:12.123917 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: from cryptography.utils import int_from_bytes Jul 12 07:12:14.370676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 07:12:14.371278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 07:12:14.371466 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 07:12:14.371821 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 07:12:14.372070 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 07:12:14.372451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.372769 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.373076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.373405 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.373718 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.374033 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.374348 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.374659 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.374980 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.375240 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.375541 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.375855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-25-iscsi {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.376172 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.376468 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.376768 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.377077 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.377395 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.377709 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.378006 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.378505 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.378945 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.379241 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.379524 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.379855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.380161 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.380461 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.380780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.381208 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.381543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.381835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.382225 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-25-iscsi {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.382533 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.382838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.383142 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.383550 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.383856 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.384161 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.384476 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.384789 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.385109 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.385430 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.385740 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.386054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.386366 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.386661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.386753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 07:12:14.387151 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.387248 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 07:12:14.387342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.387478 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 07:12:14.387587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.387827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.387929 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 07:12:14.388078 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 07:12:14.388170 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.388353 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.388451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.388653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.388755 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.388965 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.389084 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.389304 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.389406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.389620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.389724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.389866 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.390002 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.390101 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.390320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.390411 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.390634 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.390758 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.390960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.391065 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.391215 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.391357 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.391530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.391677 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.391850 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-25-iscsi {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.391961 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.392147 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.392243 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.392446 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.392549 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.392766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.392878 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.393039 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.393169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.393360 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.393468 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.393674 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.393790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.393973 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.394081 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.394921 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.395108 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.395285 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.395460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.395619 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.395771 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.395973 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.396126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.396278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.396438 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.396645 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.396828 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.396997 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.397234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.397390 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.397546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.397993 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.398154 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.398309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.398309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.398655 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.398808 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.398960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.399122 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.399276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-25-iscsi {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.399461 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.399626 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.399780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.399966 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.400130 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.400284 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.400440 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.400440 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.400726 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.400888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.401157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.401253 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.401410 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.401516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.401629 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.401726 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.401816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.401931 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.402190 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.402302 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.402420 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.402555 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.402651 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.402793 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.402900 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403018 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403122 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403262 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403361 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403435 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403505 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403574 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.403959 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.404059 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.404197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.404309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.404401 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.404482 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.404555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.404763 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.404867 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405000 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405163 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405261 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405399 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405586 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405687 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405774 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405860 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.405959 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.406047 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.406230 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.406321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.406430 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.406565 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.406739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.406867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.407032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.407198 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.407358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.407499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.407668 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.407823 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.408052 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.408191 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.408332 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.408502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.408648 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.408770 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.408881 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.409000 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.409168 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.409313 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.409445 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.409544 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.409706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.409808 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.410008 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.410137 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.410326 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.410423 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.410632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.410732 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.410929 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.411031 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.411226 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.411371 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.411521 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.411641 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.411813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.411958 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.412123 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.412412 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.412511 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.412597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.412778 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.413145 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.413265 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.413396 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.413484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.413793 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.413920 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.414022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.414124 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.414324 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.414432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.414660 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.414793 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.414960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.415095 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.415283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.415488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.415635 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.415796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.415926 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.416105 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.416210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.416433 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.416578 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.416743 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.416835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.417075 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.417183 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.417379 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.417482 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.417681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.417773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.417988 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.418106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.418298 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.418415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.418598 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.418726 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.418902 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.418995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.419205 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.419297 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.419505 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.419597 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.419805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.419905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.420105 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.420197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.420406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.420498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.420724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.420816 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.421024 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.421201 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.421400 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.421530 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.421652 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.421773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.421937 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.422038 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.422241 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.422350 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.422569 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.422673 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.422866 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.422969 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.423168 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.423271 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.423469 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.423569 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.423776 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.423867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.424431 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.424540 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.424751 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.424852 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.425085 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.425192 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.425381 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.425475 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.425686 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.425777 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.425984 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.426082 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.426289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.426381 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.426593 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.426685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.426899 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.426990 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.427201 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.427305 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.427498 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.427592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.427797 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.427891 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.428120 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.428222 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.428421 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.428566 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.428779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.428928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.429092 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.429197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.429322 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.429422 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.429616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.429707 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.429911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.430014 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.430218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.430320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.430514 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.430614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.430808 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.430901 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.431125 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:12:14.431225 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.431424 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.431547 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.431747 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.431855 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.432046 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.432157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.432346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.432454 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.432642 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.432731 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.432935 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.433079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.433284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.433401 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.433592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.433693 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.433895 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.434003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.434192 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.434321 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.434509 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.434612 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.434810 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.434912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.435105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.435216 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.435418 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.435516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.435714 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.435812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.436010 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.436116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.436314 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.436414 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.436648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.436751 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.436923 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.437026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.437250 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.437341 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.437553 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.437645 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.437870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.437963 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.438180 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.438273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.438523 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.438630 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.438805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.438897 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.439131 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.439231 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.439431 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.439539 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.439750 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.439851 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.440065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.440154 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.440371 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.440504 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.440665 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.440789 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.442064 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.442200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.442291 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.442392 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.442480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.442617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.442751 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.442887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.442977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.443071 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.443166 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.443260 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.443389 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.443584 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.443682 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.443775 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.443860 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.443950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.444034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.444125 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.444125 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.444296 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.444391 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.444476 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.444621 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.444790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.444902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.445123 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.445334 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.445472 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.445675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.445806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.445977 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.446082 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.446450 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.446545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.446640 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.446731 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.446904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.447047 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.447204 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.447309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.447507 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.447614 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.447807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.447912 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.448144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.448280 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.448461 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.448631 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.448727 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.448822 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.449020 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.449180 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.449389 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.449550 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.449655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.449748 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.449978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.450126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.450253 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.450375 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.450610 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.450743 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.450885 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.450981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.451158 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.451275 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.451473 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.451621 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.451762 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.451868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.452074 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.452223 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.452355 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.452458 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.452692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.452891 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.453006 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.453135 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.453303 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.453454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.453617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.453710 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.453910 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.454061 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.454174 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.454262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.454508 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.454662 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.454764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.454859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.455114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.455263 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.455396 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.455512 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.455733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.455881 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.455984 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.456079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.456310 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.456424 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.456621 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.456729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.456922 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.457026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.457231 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.457336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.457542 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.457638 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.457860 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.457956 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.458164 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.458268 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.458469 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.458564 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.458759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.458853 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.459173 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.459337 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.459468 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.459563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.459822 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.459987 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.460170 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.460295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.460471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.460597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.460770 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.460899 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.461101 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.461256 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.461412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.461535 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.461713 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.461856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.462015 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.462128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.462311 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.462429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.462619 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.462724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.462923 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.463050 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.463219 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.463340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.463515 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.463682 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.463819 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.464016 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.464133 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.464330 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.464572 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.464684 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.464759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.464944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.465089 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.465284 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.465405 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.465592 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.465706 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.465899 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.465999 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.466206 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.466315 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.466512 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.466874 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.467138 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.467321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.467473 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.467629 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.467773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.467925 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.468069 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.468220 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.468372 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.468524 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.468675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.468830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.468973 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.469258 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.469592 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.469930 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.470045 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.470242 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.470353 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.470561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.470672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.470868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.470970 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.471177 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.471285 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.471480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.471595 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.471785 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.471895 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.472136 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.472244 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.472398 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.472500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.472711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.472832 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.473055 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.473244 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.473360 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.473489 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.473640 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.473855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.473981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.474092 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.474251 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.474378 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.474561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.474677 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.474897 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.475017 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.475257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.475384 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.475584 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.475712 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.475913 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.476039 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.476218 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.476501 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.476629 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.476841 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.476992 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.477232 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.477457 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.477764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.477895 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.478065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.478322 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.478469 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.478656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.478814 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.478953 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.479257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.479402 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.479607 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.479736 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.479871 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.480142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.480271 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.480443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.480696 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.480828 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.481026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.481254 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.481384 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.481600 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.481757 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.481951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.482097 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.482371 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.482514 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.482681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.482846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.482982 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.483133 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.483407 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.483549 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.483727 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.483876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.484091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.484220 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.484358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.484592 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.484742 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.484930 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.485086 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.485263 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.485469 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.485602 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.485862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.485993 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.486179 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.486362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.486493 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.486732 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.486864 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.487071 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.487214 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.487436 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.487605 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.487740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.487970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.488108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.488275 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.488477 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.488618 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.488876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.489008 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.489208 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.489378 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.489512 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.489791 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.489926 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.490115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.490246 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.490598 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.490777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.490922 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.491196 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.491328 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.491507 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.491735 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.491885 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.492133 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.492412 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.492583 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.492733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.493007 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.493219 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.493520 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.493655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.493793 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.493938 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.494085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.494300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.494442 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.494572 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.494801 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.495008 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.495184 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.495325 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.495493 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.495661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.495825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.496080 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.496214 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.496383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.496557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.496690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.496978 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.497196 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.497342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.497563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.497710 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.497873 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.498017 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.498156 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.498333 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.498474 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.498744 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.498905 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.499045 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.499209 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.499350 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.499625 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.499843 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.499983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.500114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.500250 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.500491 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.500634 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.500803 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.500961 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.501127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.501398 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.501532 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.501744 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.501953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.502085 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.502263 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.502533 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.502677 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.502819 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.502979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.503119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.503283 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.503563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.503720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.503892 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.504023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.504193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.504415 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.504556 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.504779 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.504914 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.505095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.505266 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.505398 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.505678 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.505823 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.506012 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.506161 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.506427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.506580 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.506933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.507080 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.507290 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.507573 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.507785 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.507924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.508062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.508207 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.508345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.508475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.508674 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.508808 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.509035 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.509218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.509349 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.509557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.509690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.509946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.510095 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.510234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.510456 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.510597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.510817 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.510949 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.511129 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.511316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.511458 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.511719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.511850 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.512003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.512207 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.512347 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.512595 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.512737 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.512866 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.513032 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.513300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.513473 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.513738 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.513883 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.514022 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.514165 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.514329 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.514476 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.514681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.514820 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.514978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.515192 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.515326 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.515514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.515653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.515827 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.516061 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.516205 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.516421 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.516551 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.516721 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.516928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.517104 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.517410 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.517563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.517752 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.517976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.518107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.518246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.518375 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.518511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.518671 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.518805 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.519057 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.519198 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.519371 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.519577 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.519709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.520023 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.520163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.520307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.520459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.520600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.520863 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.521140 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.521302 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.521523 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.521741 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.521938 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.522243 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.522386 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.522567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.522877 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.523010 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.523187 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.523484 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.523618 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.523889 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.524022 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.524159 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.524386 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.524529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.524769 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.524923 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.525081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.525293 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.525438 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.525691 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.525832 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.526001 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.526179 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.526311 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.526614 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.526756 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.526932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.527098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.527254 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.527539 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.527689 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.527936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.528178 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.528319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.528456 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.528593 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.528723 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.528849 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.528992 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.529297 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.529432 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.529622 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.529763 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.529930 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.530166 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.530305 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.530534 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.530695 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.530830 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.531029 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.531171 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.531419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.531550 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.531722 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.531908 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.532057 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.532360 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.532510 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.532649 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.532794 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.533004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.533196 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.533342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.533526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.533658 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.533939 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.534087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.534841 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.535076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.535212 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.535341 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.535470 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.535685 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.535817 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.535817 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.536070 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.536206 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.536883 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.537039 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.537039 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.537344 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.537473 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.537628 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.537826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.538049 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.538198 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.538198 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.538198 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.538669 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.538810 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.538810 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.539054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.539193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.539193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.539447 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.539585 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.539722 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.539850 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.539978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.540141 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.540358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.540576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.540717 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.540892 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.541065 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.541392 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.541541 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.541681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.541894 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.542026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.542350 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.542565 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.542709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.542887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.543031 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.543258 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.543404 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.543575 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.543762 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.543895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.544179 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.544310 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.544482 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.544637 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.544780 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.545258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.545417 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.545417 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.545663 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.545798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.545964 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.546105 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.546317 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.546456 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.546635 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.546820 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.546989 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.547248 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.547378 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.547567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.547715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.547984 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.548207 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.548346 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.548601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.548736 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.548923 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.549475 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.549634 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.549894 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.550039 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.550231 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.550493 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.550633 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.550826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.550957 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.551130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.551355 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.551504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.551739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.551880 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.552048 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.552244 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.552387 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.552651 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.552815 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.553692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.553841 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.553971 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.554268 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.554416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.554547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.554684 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.554813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.554952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.554952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.555199 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.555344 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.555344 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.555691 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.555831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.555831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.556076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.556204 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.556340 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.556531 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.556677 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.556805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.556941 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.557211 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.557351 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.557501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.557638 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.557811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.558062 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.558217 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.558454 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.558745 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.558880 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.559051 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.559185 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.559381 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.559520 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.559692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.559945 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.560089 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.560313 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.560451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.560669 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.560889 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.561020 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.561220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.561361 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.561498 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.561695 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.561830 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.562071 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.562203 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.562377 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.562559 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.562719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.562966 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.563095 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.563222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.563466 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.563614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.563827 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.563958 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.564144 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.564447 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.564589 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.564721 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.564864 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.565005 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.565151 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.565331 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.565643 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.565814 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.566025 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.566156 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.566292 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.566430 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.566566 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.566855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.566990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.567195 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.567326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.567504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.567738 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.567885 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.568170 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.568309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.568603 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.568824 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.568958 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.569217 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.569360 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.569500 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.569640 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.569777 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.569905 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.570071 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.570312 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.570447 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.570709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.570856 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.570995 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.571221 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.571355 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.571637 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.571843 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.572066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.572208 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.572475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.572614 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.572786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.573015 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.573228 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.573408 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.573564 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.573771 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.573901 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.574030 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.574310 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.574600 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.574733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.574862 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.574990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.575186 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.575327 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.575527 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.575667 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.575911 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.580815 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.580980 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.581155 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.581293 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.581425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.581563 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.581702 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.581843 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.581982 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.582112 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.582248 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.582385 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.582517 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.582656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.582786 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.582913 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.583026 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.583325 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.583325 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.583580 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.583710 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.583949 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.585427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.585585 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.585719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.585849 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.586121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.586121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.586121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.586121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.586121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.586121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.586121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.586121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.587149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.587149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.587149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.587149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.587149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.587149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.587149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.588763 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.588903 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.589034 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.589214 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.589638 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.590028 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.590028 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.590299 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.590430 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.590588 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.590728 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.590728 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.590728 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.591579 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.591705 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.591843 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.591973 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.592130 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.593095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.593095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.593702 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.593847 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.593847 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.594230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.594370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.594498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.594498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595313 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595448 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595576 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.595712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.596490 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.596617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.596617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.596900 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.597194 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.597337 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.597483 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.597622 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.597759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.597759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.598029 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.598200 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.598335 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.598472 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.598472 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.598721 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.598855 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.598855 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.602534 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.602798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.604035 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.604297 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.604297 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.604297 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.604709 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.604859 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.604859 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.605337 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.605465 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.605465 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.605700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.605815 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.605944 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.606669 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.606669 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.606930 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.607081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.607234 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.607538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.607676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.607814 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.607944 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.608087 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.608207 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.608335 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.608463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.608581 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.608707 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.608845 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.608981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.609135 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.609274 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.609404 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.609547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.609686 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.609817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.609943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.610056 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.610182 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.610182 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.610432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.610561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.610698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.610834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.610953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.610953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611212 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611377 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611548 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611548 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611861 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.611990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.613579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.613579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.613579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.613579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.613579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.613579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.613579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.613579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.614967 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.614967 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.614967 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.614967 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.614967 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.614967 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.616229 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.616370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.616370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.616659 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.616790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.616917 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.617075 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.617218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.617348 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.617348 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.617687 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.617798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.617928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618023 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618215 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618215 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618389 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618477 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618477 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618477 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618477 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.618932 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619070 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619206 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619335 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619335 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619575 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.619713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.620361 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.620500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.620500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.620773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.620903 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.620903 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.621175 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.621319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.621319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.621579 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.621708 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.621835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.621978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.621978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.622237 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.622374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.622374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.622374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.623041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.623171 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.623299 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.623428 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.623428 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.623670 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.623831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.623831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.624268 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.624415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.624415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.624743 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.624886 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.625024 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.625208 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.625336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.625462 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.625603 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.625901 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.626042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.626172 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.626298 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.626435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.626710 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.626882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.627022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.627194 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.627336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.627606 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.627840 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.627999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.628138 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.628276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.628489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.628621 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.628833 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.628965 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.629193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.629391 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.629536 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.629811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.629949 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.630132 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.630284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.630446 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.631215 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.631376 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.631518 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.631655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.631807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.632028 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.632187 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.632332 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.632463 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.632600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.632976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.633139 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.633270 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.633492 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.633627 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.633755 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.633882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.634190 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.634345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.634485 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.634638 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.634837 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.634989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.635127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.635360 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.635499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.635676 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.635857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.636149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.636281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.636425 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.636594 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.636726 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.636911 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.637203 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.637358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.637553 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.637684 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.637910 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.638078 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.638212 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.638488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.638636 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.638811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.638963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.639117 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.639405 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.639555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.639747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.639887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.640417 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.640562 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.640692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.640830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.640961 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.641117 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.641247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.641431 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.641572 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.641743 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.641957 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.642089 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.642274 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 07:12:14.642406 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.642768 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.643147 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.643511 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.643883 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.644293 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.644632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.645002 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.645394 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.645811 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.646222 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.646561 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.647040 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.647477 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.647881 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.648271 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.648649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.649126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.649488 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.649875 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.650527 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.650926 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.651312 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.651714 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.652118 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.652466 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.652836 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.653425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.653643 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.654016 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.654498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.654770 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.655146 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.655515 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.655883 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.656435 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.656613 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.656968 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.657922 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.657922 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.658213 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.658433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.658845 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.659253 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.659649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.660041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.660417 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.660796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.661198 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.661573 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.661943 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.662419 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.662987 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.663456 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.663784 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.664137 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.664663 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.665006 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.665415 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.665801 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.666175 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.666598 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.666937 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.667310 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.667695 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.668069 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.668463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.669037 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.670072 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.670072 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.670072 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.670465 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.670594 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.670792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.671110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.671648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.671832 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.672054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.672360 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.672662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.672966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.673638 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.673808 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.674507 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.674654 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.675026 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.675211 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.675511 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.675811 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.676107 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.676412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.676739 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.677013 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.677342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.677646 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.678044 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.678391 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.678724 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.679040 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.679360 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.679704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.679996 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.680302 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.680625 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.680944 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.681303 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.681610 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.681941 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.682250 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.682561 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.682870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.683175 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.683481 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.683879 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.684117 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.684443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.684747 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.685358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.685685 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.686009 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.686324 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.686641 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.686967 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.687358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.687575 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.688158 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.688299 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.688489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.688802 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.689167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.689495 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.689829 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.690143 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.690458 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.690778 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.691129 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.691439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.691783 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.692107 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.692415 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.692723 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.693031 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:12:14.693292 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 07:12:14.800365 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO dbcounter [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Registered counter for database nova_api Jul 12 07:12:14.820806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_db.sqlalchemy.engines [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:12:14.827864 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writer thread running {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:12:14.847745 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO dbcounter [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Registered counter for database nova_api Jul 12 07:12:14.867809 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:12:14.875365 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writer thread running {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:12:14.884520 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.context [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e119ac6-6b57-4f90-ba6d-28f92a02395b(cell1) {{(pid=117997) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 07:12:14.888496 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:12:14.890105 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:12:14.890902 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:12:14.892828 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:12:14.894852 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO dbcounter [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Registered counter for database nova_cell0 Jul 12 07:12:14.898977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO dbcounter [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Registered counter for database nova_cell1 Jul 12 07:12:14.906672 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_db.sqlalchemy.engines [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:12:14.908095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_db.sqlalchemy.engines [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:12:14.914576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writer thread running {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:12:14.916414 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writer thread running {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:12:14.932051 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.context [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e119ac6-6b57-4f90-ba6d-28f92a02395b(cell1) {{(pid=117998) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 07:12:14.936046 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:12:14.937658 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:12:14.938448 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:12:14.940372 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:12:14.942387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO dbcounter [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Registered counter for database nova_cell0 Jul 12 07:12:14.946619 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO dbcounter [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Registered counter for database nova_cell1 Jul 12 07:12:14.954115 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:12:14.956314 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:12:14.963211 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writer thread running {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:12:14.964950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writer thread running {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:12:15.060533 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO dbcounter [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Registered counter for database nova_cell0 Jul 12 07:12:15.067525 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_db.sqlalchemy.engines [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:12:15.072685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writer thread running {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:12:15.111772 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO dbcounter [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Registered counter for database nova_cell0 Jul 12 07:12:15.118745 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:12:15.123625 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writer thread running {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:12:15.388053 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: WARNING keystonemiddleware.auth_token [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 07:12:15.395322 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: WARNING keystonemiddleware.auth_token [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 07:12:15.436849 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: WARNING keystonemiddleware.auth_token [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 07:12:15.445500 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: WARNING keystonemiddleware.auth_token [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 07:12:15.741472 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: WARNING keystonemiddleware.auth_token [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 07:12:15.747483 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: WARNING keystonemiddleware.auth_token [None req-5630631c-d78c-404c-9611-ab26bfe97f3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 07:12:15.752804 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c0e6499c0 pid: 117997 (default app) Jul 12 07:12:15.790245 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: WARNING keystonemiddleware.auth_token [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 07:12:15.796243 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: WARNING keystonemiddleware.auth_token [None req-e9d96409-8312-4b95-9aff-3894d95991cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 07:12:15.801932 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c0e6499c0 pid: 117998 (default app) Jul 12 07:12:56.540576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:12:56.541885 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:12:56.543012 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:12:56.543933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:12:58.095694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6cbc3b9e-1338-46a8-b348-6d0064051070 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Action: 'create', calling method: .version_select at 0x7f7013711700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-250955920"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:12:59.064576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6cbc3b9e-1338-46a8-b348-6d0064051070 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.550055 Jul 12 07:12:59.083293 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1154 bytes} [Tue Jul 12 07:12:56 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2572 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 07:12:59.092284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:12:59.096151 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:12:59.097747 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:12:59.098925 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:12:59.640388 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5703170a-fa9b-4243-8dc7-603591c638b0 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f7013758310>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:00.161788 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5703170a-fa9b-4243-8dc7-603591c638b0 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1" status: 200 len: 345 microversion: 2.1 time: 1.083674 Jul 12 07:13:00.170363 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 1/2] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:12:59 2022] GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1 => generated 345 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:00.183922 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-db4ccc75-11e5-4d57-9496-bd89ed53761d tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Action: 'create', calling method: .version_select at 0x7f70135d54c0>, body: {"snapshot": {"volume_id": "5c472a0b-0685-4bbb-9abd-67942c3b62f1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-486970824"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:01.129174 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-db4ccc75-11e5-4d57-9496-bd89ed53761d tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.950204 Jul 12 07:13:01.130354 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1161 bytes} [Tue Jul 12 07:13:00 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:13:01.141859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-86402dfc-c2eb-49f2-bdf7-3c5016eead7b tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f70136214c0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:01.262817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-86402dfc-c2eb-49f2-bdf7-3c5016eead7b tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 200 len: 286 microversion: 2.1 time: 0.125463 Jul 12 07:13:01.263597 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:01 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:01.273565 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b2ede1b-c92b-42c4-b538-e5c05a12358e tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f70135d5550>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:01.345763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b2ede1b-c92b-42c4-b538-e5c05a12358e tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.076039 Jul 12 07:13:01.346671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Jul 12 07:13:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:01.358066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-38623db0-f51b-4509-9c16-8f3831649d8b tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f7013621c10>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:01.421772 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-38623db0-f51b-4509-9c16-8f3831649d8b tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 200 len: 286 microversion: 2.1 time: 0.067906 Jul 12 07:13:01.423078 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:01 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:02.434689 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fb68447e-8006-4677-9a16-8a3c5ec6a7b4 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f70135f1280>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:02.483693 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fb68447e-8006-4677-9a16-8a3c5ec6a7b4 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 200 len: 286 microversion: 2.1 time: 0.053010 Jul 12 07:13:02.484676 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:02 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:03.496321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-221115d9-b9e8-4dd2-81b1-2f1dd169049e tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f7013621ca0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:03.552025 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-221115d9-b9e8-4dd2-81b1-2f1dd169049e tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 200 len: 286 microversion: 2.1 time: 0.059971 Jul 12 07:13:03.552944 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:03 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:04.541610 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-387c4bba-95f4-4a69-ab1e-3930027a38bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'create', calling method: .version_select at 0x7f70135f1820>, body: {"keypair": {"name": "tempest-keypair-1350638431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxGTNJH86yNs/4jNtZcfEN3w9gtrXRpVRK6Qu1XfUd5buxym2hTWsHA3ACh7pbvHxp7hxSjn9o68KkeGBCTvYKKrT+CYcOJICksS5MSnFWLl1tnoqi4kpKRgM5zxuychQ=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:04.565861 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c7be69ac-d104-4b9d-9c01-2cd9cb1fbbfd tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f70136214c0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:04.613579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-387c4bba-95f4-4a69-ab1e-3930027a38bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Getting quotas for project 2ed408b23e4c48a5861e542d02e0ee64. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:13:04.621078 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c7be69ac-d104-4b9d-9c01-2cd9cb1fbbfd tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 200 len: 286 microversion: 2.1 time: 0.059735 Jul 12 07:13:04.625725 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:04 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:13:04.625898 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-387c4bba-95f4-4a69-ab1e-3930027a38bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Getting quotas for user 53278c1c534344978ca40d7e2313c02c and project 2ed408b23e4c48a5861e542d02e0ee64. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:13:04.705379 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-387c4bba-95f4-4a69-ab1e-3930027a38bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.316548 Jul 12 07:13:04.706440 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 5/10] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 12 07:13:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 320 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 07:13:05.633618 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bee52fe0-d0e0-470c-856a-635ed9be4b78 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f70135e33a0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:05.692538 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bee52fe0-d0e0-470c-856a-635ed9be4b78 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 200 len: 287 microversion: 2.1 time: 0.063478 Jul 12 07:13:05.693149 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:05 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:05.704046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d41f3dfc-20d2-409f-a1e5-33112b882876 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f701354f940>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:05.802004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d41f3dfc-20d2-409f-a1e5-33112b882876 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 202 len: 0 microversion: 2.1 time: 0.101978 Jul 12 07:13:05.802583 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1253 bytes} [Tue Jul 12 07:13:05 2022] DELETE /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:13:05.812276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-80173602-2a95-45ea-82f5-9a5e9eded473 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f70135e3a60>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:05.888945 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-80173602-2a95-45ea-82f5-9a5e9eded473 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 200 len: 286 microversion: 2.1 time: 0.081690 Jul 12 07:13:05.898008 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:05 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:06.902578 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6c65fa51-c4ae-4f19-8cb4-981402c93a7f tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f7012cfe040>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:06.982089 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6c65fa51-c4ae-4f19-8cb4-981402c93a7f tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 200 len: 286 microversion: 2.1 time: 0.084598 Jul 12 07:13:06.983335 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:06 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:08.007250 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9d4ca6ab-5b8c-4119-a3e7-52c8d30e7c15 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f70136214c0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:08.101523 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9d4ca6ab-5b8c-4119-a3e7-52c8d30e7c15 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 200 len: 286 microversion: 2.1 time: 0.099318 Jul 12 07:13:08.106019 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:07 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:09.113908 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-92b8283e-3b37-4913-8344-9053646d6e8c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f7012cfe700>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:09.174493 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-92b8283e-3b37-4913-8344-9053646d6e8c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] HTTP exception thrown: Snapshot 23b49d4e-a21e-43d9-ae5a-7b7c761e85ef could not be found. Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-92b8283e-3b37-4913-8344-9053646d6e8c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Request method failure captured: Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef HTTP/1.1 Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR74GR2sg5Zfw71CPmOo4gJe-oq-n5Ztu8S7M0sXOsLSt6WztA8UQ0lEj2CVtvYgsRc3uOKN2vfPLLs24vTJ7u7M5oLXDq0jI-7FlZ0LTjOkVeSoOAHWYIRjgI2KvpdQux4Hp5l1lVSqjmdBu7zn-iBmkOJimPduuFS_HfAPOo3EMk8 Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: cbae5832fe834b43a2094ab3e803d9ac Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:13:09.178862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cbae5832fe834b43a2094ab3e803d9ac"}]}] Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: cbae5832fe834b43a2094ab3e803d9ac Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesSnapshotsTestJSON-2032825005-project Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: e857c369a2294c4db5f06a821f34fbf3 Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2032825005-project Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Snapshot 23b49d4e-a21e-43d9-ae5a-7b7c761e85ef could not be found. Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '23b49d4e-a21e-43d9-ae5a-7b7c761e85ef'} Jul 12 07:13:09.180246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 23b49d4e-a21e-43d9-ae5a-7b7c761e85ef could not be found. (HTTP 404) (Request-ID: req-f8ff326f-c9c9-478f-bc6d-2bfbc17c38c4) Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:09.180951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:13:09.181979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 23b49d4e-a21e-43d9-ae5a-7b7c761e85ef could not be found. Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 07:13:09.183107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 23b49d4e-a21e-43d9-ae5a-7b7c761e85ef could not be found. Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 23b49d4e-a21e-43d9-ae5a-7b7c761e85ef could not be found. Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-92b8283e-3b37-4913-8344-9053646d6e8c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Returning 404 to user: Snapshot 23b49d4e-a21e-43d9-ae5a-7b7c761e85ef could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:13:09.184376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-92b8283e-3b37-4913-8344-9053646d6e8c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef" status: 404 len: 111 microversion: 2.1 time: 0.071352 Jul 12 07:13:09.191479 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b510ee58-7a68-46eb-b57b-b9f760132878 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f7013621ca0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:09.201580 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:13:09 2022] GET /compute/v2.1/os-snapshots/23b49d4e-a21e-43d9-ae5a-7b7c761e85ef => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:13:09.387582 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b510ee58-7a68-46eb-b57b-b9f760132878 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1" status: 202 len: 0 microversion: 2.1 time: 0.201560 Jul 12 07:13:09.390274 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:13:09 2022] DELETE /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:13:09.399434 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4073d4b2-c3e8-4451-8392-af6a98113d6a tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f7012cfee50>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:09.536658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4073d4b2-c3e8-4451-8392-af6a98113d6a tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1" status: 200 len: 344 microversion: 2.1 time: 0.140423 Jul 12 07:13:09.540047 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 9/18] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:13:09 2022] GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:13:10.551731 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6714e6e3-cad1-4cb7-a3ef-c03dca24cc14 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f70135e39d0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:10.607280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-6714e6e3-cad1-4cb7-a3ef-c03dca24cc14 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] HTTP exception thrown: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6714e6e3-cad1-4cb7-a3ef-c03dca24cc14 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Request method failure captured: Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1 HTTP/1.1 Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR74GR2sg5Zfw71CPmOo4gJe-oq-n5Ztu8S7M0sXOsLSt6WztA8UQ0lEj2CVtvYgsRc3uOKN2vfPLLs24vTJ7u7M5oLXDq0jI-7FlZ0LTjOkVeSoOAHWYIRjgI2KvpdQux4Hp5l1lVSqjmdBu7zn-iBmkOJimPduuFS_HfAPOo3EMk8 Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: cbae5832fe834b43a2094ab3e803d9ac Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:13:10.611898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cbae5832fe834b43a2094ab3e803d9ac"}]}] Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: cbae5832fe834b43a2094ab3e803d9ac Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesSnapshotsTestJSON-2032825005-project Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: e857c369a2294c4db5f06a821f34fbf3 Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2032825005-project Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '5c472a0b-0685-4bbb-9abd-67942c3b62f1'} Jul 12 07:13:10.613163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. (HTTP 404) (Request-ID: req-cbf3d2d6-d98d-4bd2-9bab-84df09ddcd0c) Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:10.613928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:13:10.615108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 07:13:10.616102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6714e6e3-cad1-4cb7-a3ef-c03dca24cc14 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Returning 404 to user: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6714e6e3-cad1-4cb7-a3ef-c03dca24cc14 tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1" status: 404 len: 109 microversion: 2.1 time: 0.067235 Jul 12 07:13:10.616995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 10/19] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:13:10 2022] GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:13:10.626438 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9040b93-fab9-4965-9610-de4b48123a4c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f7012cfeb80>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:10.679410 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-d9040b93-fab9-4965-9610-de4b48123a4c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] HTTP exception thrown: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.685113 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1663963620", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2f0b23c-5195-4564-a429-b8507bb32624"}], "security_groups": [{"name": "tempest-securitygroup--1732911346"}], "key_name": "tempest-keypair-1350638431", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9040b93-fab9-4965-9610-de4b48123a4c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Request method failure captured: Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: DELETE /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1 HTTP/1.1 Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR74GR2sg5Zfw71CPmOo4gJe-oq-n5Ztu8S7M0sXOsLSt6WztA8UQ0lEj2CVtvYgsRc3uOKN2vfPLLs24vTJ7u7M5oLXDq0jI-7FlZ0LTjOkVeSoOAHWYIRjgI2KvpdQux4Hp5l1lVSqjmdBu7zn-iBmkOJimPduuFS_HfAPOo3EMk8 Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: cbae5832fe834b43a2094ab3e803d9ac Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:13:10.689671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cbae5832fe834b43a2094ab3e803d9ac"}]}] Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: cbae5832fe834b43a2094ab3e803d9ac Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesSnapshotsTestJSON-2032825005-project Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: e857c369a2294c4db5f06a821f34fbf3 Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2032825005-project Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '5c472a0b-0685-4bbb-9abd-67942c3b62f1'} Jul 12 07:13:10.690761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. (HTTP 404) (Request-ID: req-87387c22-51b5-4158-acb7-515688515d21) Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:10.691526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 07:13:10.692524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 07:13:10.693570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9040b93-fab9-4965-9610-de4b48123a4c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Returning 404 to user: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d9040b93-fab9-4965-9610-de4b48123a4c tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1" status: 404 len: 109 microversion: 2.1 time: 0.071385 Jul 12 07:13:10.694456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 10/20] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:13:10 2022] DELETE /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:13:10.704309 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99974d18-2402-43b8-8912-cbe1937e4bef tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Calling method '.version_select at 0x7f7012cde790>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:10.784265 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-99974d18-2402-43b8-8912-cbe1937e4bef tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] HTTP exception thrown: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99974d18-2402-43b8-8912-cbe1937e4bef tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Request method failure captured: Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1 HTTP/1.1 Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR74GR2sg5Zfw71CPmOo4gJe-oq-n5Ztu8S7M0sXOsLSt6WztA8UQ0lEj2CVtvYgsRc3uOKN2vfPLLs24vTJ7u7M5oLXDq0jI-7FlZ0LTjOkVeSoOAHWYIRjgI2KvpdQux4Hp5l1lVSqjmdBu7zn-iBmkOJimPduuFS_HfAPOo3EMk8 Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: cbae5832fe834b43a2094ab3e803d9ac Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:13:10.790979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cbae5832fe834b43a2094ab3e803d9ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cbae5832fe834b43a2094ab3e803d9ac"}]}] Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: cbae5832fe834b43a2094ab3e803d9ac Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2032825005 Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesSnapshotsTestJSON-2032825005-project Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: e857c369a2294c4db5f06a821f34fbf3 Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2032825005-project Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '5c472a0b-0685-4bbb-9abd-67942c3b62f1'} Jul 12 07:13:10.792996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. (HTTP 404) (Request-ID: req-ae625762-1755-405b-8d18-29ac167c1e94) Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:10.794222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:13:10.795675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 07:13:10.797876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. Jul 12 07:13:10.800779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:13:10.806341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99974d18-2402-43b8-8912-cbe1937e4bef tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] Returning 404 to user: Volume 5c472a0b-0685-4bbb-9abd-67942c3b62f1 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:13:10.806341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-99974d18-2402-43b8-8912-cbe1937e4bef tempest-VolumesSnapshotsTestJSON-2032825005 tempest-VolumesSnapshotsTestJSON-2032825005-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1" status: 404 len: 109 microversion: 2.1 time: 0.102445 Jul 12 07:13:10.806341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:13:10 2022] GET /compute/v2.1/os-volumes/5c472a0b-0685-4bbb-9abd-67942c3b62f1 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:13:11.636705 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] validate_networks() for [('e2f0b23c-5195-4564-a429-b8507bb32624', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:13:14.080778 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:13:14.081432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:13:14.081720 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:13:14.082523 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:13:14.083076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:13:14.125402 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:14.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:14.129234 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:14.132457 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:14.217719 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Getting quotas for project 2ed408b23e4c48a5861e542d02e0ee64. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:13:14.255364 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Getting quotas for user 53278c1c534344978ca40d7e2313c02c and project 2ed408b23e4c48a5861e542d02e0ee64. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:13:14.291701 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:13:14.302783 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:13:14.532951 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1367b0b0-41ca-4db0-9e1d-8f90feaeea26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.853969 Jul 12 07:13:14.541769 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 11/22] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 12 07:13:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 3863 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 07:13:14.560453 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aa1bc67f-2a2e-4306-b597-034baf7d3092 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:14.563957 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aa1bc67f-2a2e-4306-b597-034baf7d3092 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:14.660783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=4 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:14.929127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aa1bc67f-2a2e-4306-b597-034baf7d3092 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:15.023237 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aa1bc67f-2a2e-4306-b597-034baf7d3092 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:15.035568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aa1bc67f-2a2e-4306-b597-034baf7d3092 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:15.039347 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aa1bc67f-2a2e-4306-b597-034baf7d3092 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1282 microversion: 2.20 time: 0.498485 Jul 12 07:13:15.049556 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 12/23] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:14 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1282 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:15.630038 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4937dad0-ed08-4b2e-8588-8cf8c33d5b6d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'create', calling method: .version_select at 0x7f7012c3f8b0>, body: {"keypair": {"name": "tempest-keypair-1909216290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5GqJt3btsXv4VcdUj9cxs6oa5byhEazAIv1S7KsvDr9A8pITz2XzdIyLIi5GgcisdI8f51tKHeR5vApVmJtaN4DIhfqGs+bVmcugl2nIm+FQm1aEkQWPUMvnd2T/sBDg=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:15.712672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-4937dad0-ed08-4b2e-8588-8cf8c33d5b6d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Getting quotas for project 6be635735d174893be20f99110cacbfa. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:13:15.733841 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-4937dad0-ed08-4b2e-8588-8cf8c33d5b6d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Getting quotas for user 583143af14a645238262214515ee148f and project 6be635735d174893be20f99110cacbfa. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:13:15.880478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4937dad0-ed08-4b2e-8588-8cf8c33d5b6d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.041361 Jul 12 07:13:15.881116 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 12/24] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:13:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:16.059873 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-21f59bcc-549a-4c99-9abb-6b1346cf70af tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:16.060486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-21f59bcc-549a-4c99-9abb-6b1346cf70af tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:16.389446 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-21f59bcc-549a-4c99-9abb-6b1346cf70af tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:16.422278 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-21f59bcc-549a-4c99-9abb-6b1346cf70af tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:16.425348 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-21f59bcc-549a-4c99-9abb-6b1346cf70af tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:16.428722 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-21f59bcc-549a-4c99-9abb-6b1346cf70af tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1282 microversion: 2.20 time: 0.372742 Jul 12 07:13:16.430229 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 13/25] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:16 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1282 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:17.583096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1263855063", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:17.811981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] validate_networks() for [('7ea7e59d-da2f-4f32-87f4-8db38c9ed917', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:13:18.173201 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d2cde8ce-a8e5-44cf-8402-dd006e8238d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: .version_select at 0x7f7012ca9700>, body: {"keypair": {"name": "tempest-keypair-2144233527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/PtemTe1OQX9EzXnY9uUXOUCw9o2I55IVBJ4XxsBE1b862itEk82wGOFIn641T/fElWXDw7P+UQRcNsoHYmV9ML5DrBjYYJZk+B5oCGACwoXNO4V7j43nM/ZT9nInnFA=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:18.232566 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-d2cde8ce-a8e5-44cf-8402-dd006e8238d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for project b52e5f4c43a3469db851b4704f422448. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:13:18.243752 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-d2cde8ce-a8e5-44cf-8402-dd006e8238d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for user ef6395fa14b54c43931ffeaab023d97c and project b52e5f4c43a3469db851b4704f422448. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:13:18.310147 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d2cde8ce-a8e5-44cf-8402-dd006e8238d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.304736 Jul 12 07:13:18.318141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 14/26] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:13:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:18.339155 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:18.340031 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:18.369449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:18.376415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:18.380033 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:18.382685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:18.868319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:18.905927 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:18.913826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:18.917626 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a599ffe7-2f6f-464f-b826-f8e45d831a79 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1334 microversion: 2.20 time: 0.598170 Jul 12 07:13:18.920010 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 15/27] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:18 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1334 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:19.287907 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-534368057", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "networks": [{"uuid": "b8dbe1c8-b4d3-45bd-baac-d88cdb94bd82"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:19.438848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] validate_networks() for [('b8dbe1c8-b4d3-45bd-baac-d88cdb94bd82', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:13:20.070963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:13:20.071395 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:13:20.071924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:13:20.072412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:13:20.073761 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:13:20.120342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:20.121152 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:20.127263 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:20.143679 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:20.207500 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Getting quotas for project 02510f7812444c59bec582ff1127aa13. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:13:20.217635 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Getting quotas for user 7093cc7cf9d1472db33b31e5f98a5141 and project 02510f7812444c59bec582ff1127aa13. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:13:20.256907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:13:20.261445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:13:20.376545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7dc0378f-24c7-4c36-9150-f6b58dc62829 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.708099 Jul 12 07:13:20.388518 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 13/28] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:13:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 3721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:13:20.408350 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-52aeb768-e4fc-49d4-bfd0-c97638fb79cb tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7012c641f0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:20.621091 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-52aeb768-e4fc-49d4-bfd0-c97638fb79cb tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0798beff-6ec0-4780-857e-1ec0f9b25104" status: 200 len: 351 microversion: 2.1 time: 0.230893 Jul 12 07:13:20.621684 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:13:20 2022] GET /compute/v2.1/os-volumes/0798beff-6ec0-4780-857e-1ec0f9b25104 => generated 351 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:20.627512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:20.628119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:20.672425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:20.672886 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:20.674092 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:20.674526 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:21.768443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:21.831099 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:21.835167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:21.839636 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7afea99a-9e70-4cfd-9aa3-04e0fe4204ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1340 microversion: 2.20 time: 1.216763 Jul 12 07:13:21.845366 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 15/30] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:20 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1340 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:21.861672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-95a01532-e85d-4eb6-8db2-4c9c96334658 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:21.863691 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-95a01532-e85d-4eb6-8db2-4c9c96334658 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:22.201170 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-95a01532-e85d-4eb6-8db2-4c9c96334658 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:22.232127 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-95a01532-e85d-4eb6-8db2-4c9c96334658 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1222 microversion: 2.1 time: 0.383347 Jul 12 07:13:22.247238 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 16/31] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:21 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1222 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:22.267514 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1660238932", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2bae3d57-a0aa-4a3b-ba1d-f05c52c7ab17"}], "security_groups": [{"name": "tempest-securitygroup--1477006931"}], "key_name": "tempest-keypair-1909216290", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:22.328921 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:13:22.329503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:13:22.329960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:13:22.330537 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:13:22.331302 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:13:22.347383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:22.350663 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:22.354630 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:22.355476 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:22.419769 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Getting quotas for project c1156aa267ff456b849a9fd0c1a43357. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:13:22.431197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Getting quotas for user 8f1fe433179944b2b234ae9f164e8133 and project c1156aa267ff456b849a9fd0c1a43357. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:13:22.460449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:13:22.470544 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:13:22.563182 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] validate_networks() for [('2bae3d57-a0aa-4a3b-ba1d-f05c52c7ab17', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:13:22.643121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-00b41ecc-fc6b-4ba1-a27b-7352682c0d4f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.703486 Jul 12 07:13:22.653125 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 16/32] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:13:22.668366 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0fdb59e1-5d5b-4a7a-9022-877e0712ca24 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7012b72550>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:22.810588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0fdb59e1-5d5b-4a7a-9022-877e0712ca24 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f658b376-2ac7-4ae3-a1cd-d319da814136" status: 200 len: 350 microversion: 2.1 time: 0.155186 Jul 12 07:13:22.811172 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 17/33] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:13:22 2022] GET /compute/v2.1/os-volumes/f658b376-2ac7-4ae3-a1cd-d319da814136 => generated 350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:22.817606 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ad171aad-c946-4ea0-ab47-6d3723495478 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:22.818579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ad171aad-c946-4ea0-ab47-6d3723495478 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:23.340821 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ad171aad-c946-4ea0-ab47-6d3723495478 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:23.361182 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ad171aad-c946-4ea0-ab47-6d3723495478 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1214 microversion: 2.1 time: 0.543994 Jul 12 07:13:23.364159 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 18/34] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:22 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1214 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:23.389748 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2045636144", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:23.602737 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] validate_networks() for [('7ea7e59d-da2f-4f32-87f4-8db38c9ed917', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:13:25.674446 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:13:25.677838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:13:25.680791 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:13:25.681734 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:13:25.682942 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:13:25.732726 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:25.733212 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:25.745290 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:25.747325 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:25.867813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Getting quotas for project 6be635735d174893be20f99110cacbfa. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:13:25.888358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Getting quotas for user 583143af14a645238262214515ee148f and project 6be635735d174893be20f99110cacbfa. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:13:25.953000 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:13:25.966262 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:13:26.195611 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1fe8db45-d031-4fea-8af7-5349b72825fd tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.946608 Jul 12 07:13:26.196262 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 17/35] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:13:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 3948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:13:26.237007 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:26.238124 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:26.345526 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:26.345979 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:26.346878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:26.347349 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:26.973980 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:13:26.975278 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:13:26.975943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:13:26.976774 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:13:26.977388 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:13:26.982692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=5 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:27.009472 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:27.009930 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:27.010833 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:27.017978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:27.069559 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:27.082950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:27.086570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Getting quotas for project 02510f7812444c59bec582ff1127aa13. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:13:27.090952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:27.092812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Getting quotas for user 7093cc7cf9d1472db33b31e5f98a5141 and project 02510f7812444c59bec582ff1127aa13. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:13:27.097082 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c3bf1960-d036-4ae5-a24c-ed0aa3bb44dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.893161 Jul 12 07:13:27.100878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 18/36] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:26 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:27.105843 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-983bce3b-7144-4b7b-9302-1fd92e913ef7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:27.121817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-983bce3b-7144-4b7b-9302-1fd92e913ef7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:27.129852 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:13:27.140269 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:13:27.144359 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-983bce3b-7144-4b7b-9302-1fd92e913ef7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:27.149489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-983bce3b-7144-4b7b-9302-1fd92e913ef7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:27.154090 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-983bce3b-7144-4b7b-9302-1fd92e913ef7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:27.157291 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-983bce3b-7144-4b7b-9302-1fd92e913ef7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:27.372277 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0f04dbf6-857e-46e9-a8a9-cce21e88eacb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.003226 Jul 12 07:13:27.374561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:13:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 4009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:13:27.410116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ec4cee0f-8a7a-42f0-b7f3-55b0675c3da1 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7011afc790>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:27.461016 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-983bce3b-7144-4b7b-9302-1fd92e913ef7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:27.480510 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-983bce3b-7144-4b7b-9302-1fd92e913ef7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1272 microversion: 2.1 time: 0.374728 Jul 12 07:13:27.484531 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 19/38] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:27 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1272 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:27.503182 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bf449f1b-fbf2-48e0-b91e-3245b163de44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:27.504092 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bf449f1b-fbf2-48e0-b91e-3245b163de44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:27.530990 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bf449f1b-fbf2-48e0-b91e-3245b163de44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:27.536257 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bf449f1b-fbf2-48e0-b91e-3245b163de44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:27.539000 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bf449f1b-fbf2-48e0-b91e-3245b163de44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:27.540286 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bf449f1b-fbf2-48e0-b91e-3245b163de44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:27.635061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ec4cee0f-8a7a-42f0-b7f3-55b0675c3da1 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d9b15cd4-7078-4b31-84a9-dde30af581d3" status: 200 len: 350 microversion: 2.1 time: 0.251814 Jul 12 07:13:27.645305 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 20/39] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:13:27 2022] GET /compute/v2.1/os-volumes/d9b15cd4-7078-4b31-84a9-dde30af581d3 => generated 350 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:27.651484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b30cbafd-f7b1-4274-888d-c2a06c8a02fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:27.654300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b30cbafd-f7b1-4274-888d-c2a06c8a02fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:27.841739 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bf449f1b-fbf2-48e0-b91e-3245b163de44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:27.850835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bf449f1b-fbf2-48e0-b91e-3245b163de44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1242 microversion: 2.1 time: 0.364245 Jul 12 07:13:27.856907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 20/40] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:27 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1242 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:27.867218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dc6c9a1f-3626-4a2f-8487-8862f75efb9f tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7011b51ca0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:27.996645 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b30cbafd-f7b1-4274-888d-c2a06c8a02fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:28.005434 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b30cbafd-f7b1-4274-888d-c2a06c8a02fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1222 microversion: 2.1 time: 0.357914 Jul 12 07:13:28.017192 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 21/41] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:27 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1222 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:28.118118 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:28.118972 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:28.146813 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:28.149895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:28.153367 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:28.155266 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:28.203522 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dc6c9a1f-3626-4a2f-8487-8862f75efb9f tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.343069 Jul 12 07:13:28.215300 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 21/42] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Jul 12 07:13:27 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:28.226360 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-038bf9ae-c73e-41de-bf2e-2611d9544ba0 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7011aff9d0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:28.357558 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-038bf9ae-c73e-41de-bf2e-2611d9544ba0 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.140995 Jul 12 07:13:28.358500 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 22/43] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 12 07:13:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:28.373335 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b8573316-f7e3-45d9-8264-6a55eca34c00 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7011b63310>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:28.615948 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b8573316-f7e3-45d9-8264-6a55eca34c00 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.246525 Jul 12 07:13:28.616653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 23/44] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Jul 12 07:13:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:28.626618 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-52abf583-4229-4285-8fe0-1253ec77744b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:28.627394 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-52abf583-4229-4285-8fe0-1253ec77744b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:28.652160 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52abf583-4229-4285-8fe0-1253ec77744b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:28.653775 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52abf583-4229-4285-8fe0-1253ec77744b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:28.656899 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52abf583-4229-4285-8fe0-1253ec77744b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:28.657644 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52abf583-4229-4285-8fe0-1253ec77744b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:29.009250 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52abf583-4229-4285-8fe0-1253ec77744b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:29.020187 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-52abf583-4229-4285-8fe0-1253ec77744b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1272 microversion: 2.1 time: 0.402449 Jul 12 07:13:29.026391 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 24/45] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:28 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1272 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:29.039750 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-58b28c48-b91a-4d8a-8847-9a0cd76a2ed5 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7011b51e50>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:29.352957 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-58b28c48-b91a-4d8a-8847-9a0cd76a2ed5 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.318684 Jul 12 07:13:29.360778 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 25/46] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Jul 12 07:13:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:29.365722 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f5de309d-d013-48ab-85e6-0d91b429fc13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:29.366332 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f5de309d-d013-48ab-85e6-0d91b429fc13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:29.401101 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f5de309d-d013-48ab-85e6-0d91b429fc13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:29.402090 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f5de309d-d013-48ab-85e6-0d91b429fc13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:29.402892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f5de309d-d013-48ab-85e6-0d91b429fc13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:29.412088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f5de309d-d013-48ab-85e6-0d91b429fc13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:29.527916 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:29.538706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:29.552868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:29.562385 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-132c9ac8-004c-4c85-b178-d8f0c705ee85 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 1.444743 Jul 12 07:13:29.565454 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 22/47] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:28 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:29.591593 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f25ff4b3-8e95-4083-854a-d92d1f885e33 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:29.595229 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f25ff4b3-8e95-4083-854a-d92d1f885e33 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:29.614936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f25ff4b3-8e95-4083-854a-d92d1f885e33 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:29.615793 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f25ff4b3-8e95-4083-854a-d92d1f885e33 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:29.617459 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f25ff4b3-8e95-4083-854a-d92d1f885e33 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:29.620094 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f25ff4b3-8e95-4083-854a-d92d1f885e33 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:29.655922 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f5de309d-d013-48ab-85e6-0d91b429fc13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:29.664306 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f5de309d-d013-48ab-85e6-0d91b429fc13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1308 microversion: 2.1 time: 0.302364 Jul 12 07:13:29.672205 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 26/48] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:29 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:29.697175 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5f0f5771-49ac-415f-871a-30327fc0ec99 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7011b519d0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:29.846356 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f25ff4b3-8e95-4083-854a-d92d1f885e33 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:29.859317 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f25ff4b3-8e95-4083-854a-d92d1f885e33 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1274 microversion: 2.1 time: 0.289698 Jul 12 07:13:29.881684 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 23/49] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:29 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1274 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:30.018982 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5f0f5771-49ac-415f-871a-30327fc0ec99 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.345591 Jul 12 07:13:30.020409 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 27/50] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Jul 12 07:13:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:30.034508 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0c4b63c8-8d0e-4682-9faa-9d4c1cd2728f tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7011afcc10>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:30.052421 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-30719342-9575-4c61-a6b8-5274c618e7ff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:30.064096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-30719342-9575-4c61-a6b8-5274c618e7ff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:30.079075 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-30719342-9575-4c61-a6b8-5274c618e7ff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:30.091069 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-30719342-9575-4c61-a6b8-5274c618e7ff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:30.092299 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-30719342-9575-4c61-a6b8-5274c618e7ff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:30.093118 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-30719342-9575-4c61-a6b8-5274c618e7ff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:30.238254 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-30719342-9575-4c61-a6b8-5274c618e7ff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:30.258677 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-30719342-9575-4c61-a6b8-5274c618e7ff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1272 microversion: 2.1 time: 0.215883 Jul 12 07:13:30.260186 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 28/51] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:30 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:30.510253 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0c4b63c8-8d0e-4682-9faa-9d4c1cd2728f tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.481035 Jul 12 07:13:30.511441 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 24/52] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 12 07:13:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:30.523362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a530411d-1513-4fd9-b409-bc5bbad8ff32 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7011b51b80>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:30.584235 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:30.587673 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:30.619235 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:30.630845 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:30.633604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:30.639361 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:30.911708 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a530411d-1513-4fd9-b409-bc5bbad8ff32 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.392173 Jul 12 07:13:30.912794 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 29/53] 10.222.0.25 () {58 vars in 1187 bytes} [Tue Jul 12 07:13:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:30.922402 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a8fdc1bf-bbdf-4dce-ad07-dacdd3ea1fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:30.924010 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a8fdc1bf-bbdf-4dce-ad07-dacdd3ea1fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:30.933762 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8fdc1bf-bbdf-4dce-ad07-dacdd3ea1fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:30.934705 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8fdc1bf-bbdf-4dce-ad07-dacdd3ea1fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:30.936424 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8fdc1bf-bbdf-4dce-ad07-dacdd3ea1fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:30.937478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a8fdc1bf-bbdf-4dce-ad07-dacdd3ea1fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:31.569637 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a8fdc1bf-bbdf-4dce-ad07-dacdd3ea1fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:31.598854 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a8fdc1bf-bbdf-4dce-ad07-dacdd3ea1fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1296 microversion: 2.1 time: 0.684617 Jul 12 07:13:31.603600 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 30/54] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:30 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1296 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:31.622516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a0f2e006-105f-4d2c-bca3-b421f0d352b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:31.631203 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a0f2e006-105f-4d2c-bca3-b421f0d352b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:31.665193 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a0f2e006-105f-4d2c-bca3-b421f0d352b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:31.668951 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a0f2e006-105f-4d2c-bca3-b421f0d352b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:31.673496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a0f2e006-105f-4d2c-bca3-b421f0d352b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:31.673985 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a0f2e006-105f-4d2c-bca3-b421f0d352b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:32.538000 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a0f2e006-105f-4d2c-bca3-b421f0d352b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:32.551472 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a0f2e006-105f-4d2c-bca3-b421f0d352b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1280 microversion: 2.1 time: 0.946715 Jul 12 07:13:32.552149 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 31/55] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:31 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1280 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:32.570614 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f22df9aa-1385-414b-b24f-e43f9e4001d0 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] Calling method '.version_select at 0x7f7011b0a4c0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:32.816955 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f22df9aa-1385-414b-b24f-e43f9e4001d0 tempest-VolumesTestJSON-825566657 tempest-VolumesTestJSON-825566657-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.253602 Jul 12 07:13:32.829132 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 32/56] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 12 07:13:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:32.829662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4cdbc30b-8ac7-428b-bc6e-f32c071a076b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:32.830595 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4cdbc30b-8ac7-428b-bc6e-f32c071a076b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:32.855739 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4cdbc30b-8ac7-428b-bc6e-f32c071a076b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:32.860774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4cdbc30b-8ac7-428b-bc6e-f32c071a076b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:32.862193 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4cdbc30b-8ac7-428b-bc6e-f32c071a076b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:32.863406 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4cdbc30b-8ac7-428b-bc6e-f32c071a076b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:33.441760 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:33.462849 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:33.469613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:33.482391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-24e51b07-54a5-4b25-8be7-4d74ea730b38 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 2.901746 Jul 12 07:13:33.484575 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 25/57] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:30 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 2906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:33.511074 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-17756574", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d84884e5-7556-4a7f-b022-9bd7a9e42f24"}], "security_groups": [{"name": "tempest-securitygroup--1959979872"}], "key_name": "tempest-keypair-2144233527", "user_data": "}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:34.864459 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] validate_networks() for [('d84884e5-7556-4a7f-b022-9bd7a9e42f24', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:13:35.105065 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4cdbc30b-8ac7-428b-bc6e-f32c071a076b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:35.120138 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4cdbc30b-8ac7-428b-bc6e-f32c071a076b tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 2.300226 Jul 12 07:13:35.126369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 33/58] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:32 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:35.136412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7219c82f-ff47-4203-96e2-971cf7b95284 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:35.137296 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7219c82f-ff47-4203-96e2-971cf7b95284 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:35.150906 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7219c82f-ff47-4203-96e2-971cf7b95284 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:35.151622 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7219c82f-ff47-4203-96e2-971cf7b95284 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:35.153930 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7219c82f-ff47-4203-96e2-971cf7b95284 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:35.157190 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7219c82f-ff47-4203-96e2-971cf7b95284 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:35.445734 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7219c82f-ff47-4203-96e2-971cf7b95284 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:35.455029 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7219c82f-ff47-4203-96e2-971cf7b95284 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.327274 Jul 12 07:13:35.466815 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 34/59] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:35 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:35.472776 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dfb8556a-b3fe-40ea-8e5e-a8a404fd9f00 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:35.473716 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dfb8556a-b3fe-40ea-8e5e-a8a404fd9f00 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:35.488782 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfb8556a-b3fe-40ea-8e5e-a8a404fd9f00 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:35.489281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfb8556a-b3fe-40ea-8e5e-a8a404fd9f00 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:35.490309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfb8556a-b3fe-40ea-8e5e-a8a404fd9f00 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:35.490919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dfb8556a-b3fe-40ea-8e5e-a8a404fd9f00 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:35.808876 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:35.936369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=24 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:36.148627 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dfb8556a-b3fe-40ea-8e5e-a8a404fd9f00 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:36.158088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dfb8556a-b3fe-40ea-8e5e-a8a404fd9f00 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.688940 Jul 12 07:13:36.158689 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 35/60] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:35 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:36.391724 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-166ff0f3-2e59-4fcd-bb4c-aece9297502c req-43507ef2-e7c7-4b45-a80a-b957cf5baf9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1dba59c-e816-486d-9296-9fcd6e5a51ff", "tag": "e091627f-3767-4ff2-9414-c9935125f0fb"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:36.407056 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-166ff0f3-2e59-4fcd-bb4c-aece9297502c req-43507ef2-e7c7-4b45-a80a-b957cf5baf9f service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:36.409022 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-166ff0f3-2e59-4fcd-bb4c-aece9297502c req-43507ef2-e7c7-4b45-a80a-b957cf5baf9f service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:36.433759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-166ff0f3-2e59-4fcd-bb4c-aece9297502c req-43507ef2-e7c7-4b45-a80a-b957cf5baf9f service nova] Creating event network-changed:e091627f-3767-4ff2-9414-c9935125f0fb for instance e1dba59c-e816-486d-9296-9fcd6e5a51ff on hv-cinder-82549 Jul 12 07:13:36.434612 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-166ff0f3-2e59-4fcd-bb4c-aece9297502c req-43507ef2-e7c7-4b45-a80a-b957cf5baf9f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117998) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 07:13:36.437533 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c323ddaf-b97e-4941-bb52-20e7053cf2cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:36.438200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c323ddaf-b97e-4941-bb52-20e7053cf2cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:36.439192 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c323ddaf-b97e-4941-bb52-20e7053cf2cb None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:36.439793 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c323ddaf-b97e-4941-bb52-20e7053cf2cb None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:36.452025 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.compute.rpcapi [None req-c323ddaf-b97e-4941-bb52-20e7053cf2cb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 07:13:36.453373 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c323ddaf-b97e-4941-bb52-20e7053cf2cb None None] Releasing lock "compute-rpcapi-router" {{(pid=117998) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 07:13:36.488689 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c323ddaf-b97e-4941-bb52-20e7053cf2cb None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315310 Jul 12 07:13:36.489339 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 36/61] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:36.494523 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:36.495887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:36.505320 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:36.506034 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:36.506943 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:36.507495 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:36.910392 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:13:36.912563 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:13:36.913781 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:13:36.914536 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:13:36.915755 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:13:36.937848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:36.939231 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:36.940509 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:36.943109 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:37.007183 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for project b52e5f4c43a3469db851b4704f422448. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:13:37.016127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for user ef6395fa14b54c43931ffeaab023d97c and project b52e5f4c43a3469db851b4704f422448. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:13:37.035421 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:13:37.040444 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:13:37.146815 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1eafa400-a07b-4e7a-8582-36321ce14055 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.655075 Jul 12 07:13:37.147895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 26/62] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:13:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 3661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:13:37.160319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-53a4fd81-5b8a-4e53-bacc-7604fda848fe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:37.162592 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-53a4fd81-5b8a-4e53-bacc-7604fda848fe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:37.184855 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53a4fd81-5b8a-4e53-bacc-7604fda848fe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:37.187758 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53a4fd81-5b8a-4e53-bacc-7604fda848fe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:37.194663 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53a4fd81-5b8a-4e53-bacc-7604fda848fe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:37.195950 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53a4fd81-5b8a-4e53-bacc-7604fda848fe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:38.134475 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:38.146013 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:38.151164 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:38.152404 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7524676f-ddd0-4466-9374-618bd1a14409 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 1.661917 Jul 12 07:13:38.163671 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 37/63] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:36 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:38.170354 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ba68ca2d-8b63-45e2-b517-d638bd7ca9b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:38.173172 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ba68ca2d-8b63-45e2-b517-d638bd7ca9b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:38.195874 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba68ca2d-8b63-45e2-b517-d638bd7ca9b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:38.196392 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba68ca2d-8b63-45e2-b517-d638bd7ca9b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:38.197267 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba68ca2d-8b63-45e2-b517-d638bd7ca9b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:38.198937 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba68ca2d-8b63-45e2-b517-d638bd7ca9b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:39.254234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-53a4fd81-5b8a-4e53-bacc-7604fda848fe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:39.265348 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-53a4fd81-5b8a-4e53-bacc-7604fda848fe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 2.115488 Jul 12 07:13:39.275374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 27/64] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:37 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:39.280957 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f1d2811c-5d92-4e6a-b9d1-fe5bc86aad78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:39.281983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f1d2811c-5d92-4e6a-b9d1-fe5bc86aad78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:39.288615 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1d2811c-5d92-4e6a-b9d1-fe5bc86aad78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:39.289410 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1d2811c-5d92-4e6a-b9d1-fe5bc86aad78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:39.290540 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1d2811c-5d92-4e6a-b9d1-fe5bc86aad78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:39.291499 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1d2811c-5d92-4e6a-b9d1-fe5bc86aad78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:39.418493 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f1d2811c-5d92-4e6a-b9d1-fe5bc86aad78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:39.428961 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f1d2811c-5d92-4e6a-b9d1-fe5bc86aad78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1300 microversion: 2.1 time: 0.151897 Jul 12 07:13:39.431312 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 28/65] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:39 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1300 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:39.438175 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ba68ca2d-8b63-45e2-b517-d638bd7ca9b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:39.452394 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ba68ca2d-8b63-45e2-b517-d638bd7ca9b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 1.294975 Jul 12 07:13:39.453391 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 38/66] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:38 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:39.465157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35676425-2c2d-4909-bc11-b8d53ef7d04f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:39.467661 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-35676425-2c2d-4909-bc11-b8d53ef7d04f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:39.484097 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35676425-2c2d-4909-bc11-b8d53ef7d04f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:39.484684 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35676425-2c2d-4909-bc11-b8d53ef7d04f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:39.489373 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35676425-2c2d-4909-bc11-b8d53ef7d04f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:39.489826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35676425-2c2d-4909-bc11-b8d53ef7d04f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:39.723376 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-7b1f668b-b815-4957-b904-d6a56d0f26f6 req-a4d70638-852b-4ddf-a6d2-9a29a758374f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14bfba8-c99f-4905-8313-a0f83ba9a1e0", "tag": "7d978e15-5dca-4e8f-bd74-442e479f7431"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:39.733705 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:39.736010 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-7b1f668b-b815-4957-b904-d6a56d0f26f6 req-a4d70638-852b-4ddf-a6d2-9a29a758374f service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:39.736444 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-7b1f668b-b815-4957-b904-d6a56d0f26f6 req-a4d70638-852b-4ddf-a6d2-9a29a758374f service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:39.748100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-7b1f668b-b815-4957-b904-d6a56d0f26f6 req-a4d70638-852b-4ddf-a6d2-9a29a758374f service nova] Creating event network-changed:7d978e15-5dca-4e8f-bd74-442e479f7431 for instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 on hv-cinder-82549 Jul 12 07:13:39.754126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-7b1f668b-b815-4957-b904-d6a56d0f26f6 req-a4d70638-852b-4ddf-a6d2-9a29a758374f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295817 Jul 12 07:13:39.755255 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 39/67] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:39.760675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:39.762174 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:39.769727 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:39.770629 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:39.771557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:39.772103 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:39.794909 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:39.974522 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-35676425-2c2d-4909-bc11-b8d53ef7d04f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:39.987385 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-35676425-2c2d-4909-bc11-b8d53ef7d04f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.554544 Jul 12 07:13:39.988313 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 29/68] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:39 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:39.992833 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-fe0e7014-ebf6-4928-97d9-eb47a85a399c req-070a3a03-810d-44ef-96d6-de47215e91c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8a100f3-9f55-417b-b3c6-42ca96d65d76", "tag": "1ed4c67e-98fe-48ca-9c55-208d67325841"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:40.019593 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-fe0e7014-ebf6-4928-97d9-eb47a85a399c req-070a3a03-810d-44ef-96d6-de47215e91c4 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:40.020043 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-fe0e7014-ebf6-4928-97d9-eb47a85a399c req-070a3a03-810d-44ef-96d6-de47215e91c4 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:40.067731 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-fe0e7014-ebf6-4928-97d9-eb47a85a399c req-070a3a03-810d-44ef-96d6-de47215e91c4 service nova] Creating event network-changed:1ed4c67e-98fe-48ca-9c55-208d67325841 for instance c8a100f3-9f55-417b-b3c6-42ca96d65d76 on hv-cinder-82549 Jul 12 07:13:40.068276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-fe0e7014-ebf6-4928-97d9-eb47a85a399c req-070a3a03-810d-44ef-96d6-de47215e91c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117997) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 07:13:40.069472 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2a63c9c-466d-4825-bf28-3171ca587eb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:40.069904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2a63c9c-466d-4825-bf28-3171ca587eb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:40.074719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2a63c9c-466d-4825-bf28-3171ca587eb9 None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:40.075394 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2a63c9c-466d-4825-bf28-3171ca587eb9 None None] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:40.087427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.compute.rpcapi [None req-f2a63c9c-466d-4825-bf28-3171ca587eb9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 07:13:40.094072 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2a63c9c-466d-4825-bf28-3171ca587eb9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117997) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 07:13:40.123259 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:40.131670 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f2a63c9c-466d-4825-bf28-3171ca587eb9 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142082 Jul 12 07:13:40.131911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:40.135092 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 30/69] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:40.137004 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:40.139002 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-eb977c87-21eb-40a2-b8ff-c945e84c55ca tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.382509 Jul 12 07:13:40.139565 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 40/70] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:39 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:40.283116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c99393ae-0668-42c5-a83a-e7c94c5a3591 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:40.284205 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c99393ae-0668-42c5-a83a-e7c94c5a3591 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:40.290995 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c99393ae-0668-42c5-a83a-e7c94c5a3591 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:40.291447 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c99393ae-0668-42c5-a83a-e7c94c5a3591 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:40.292193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c99393ae-0668-42c5-a83a-e7c94c5a3591 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:40.292796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c99393ae-0668-42c5-a83a-e7c94c5a3591 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:40.436377 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c99393ae-0668-42c5-a83a-e7c94c5a3591 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:40.444674 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c99393ae-0668-42c5-a83a-e7c94c5a3591 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.165723 Jul 12 07:13:40.445689 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 31/71] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:40 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:40.447443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-926262f0-3840-4039-bf21-d17cd991f782 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:40.448047 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-926262f0-3840-4039-bf21-d17cd991f782 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:40.458595 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-926262f0-3840-4039-bf21-d17cd991f782 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:40.459199 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-926262f0-3840-4039-bf21-d17cd991f782 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:40.460126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-926262f0-3840-4039-bf21-d17cd991f782 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:40.460700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-926262f0-3840-4039-bf21-d17cd991f782 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:40.470863 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b340773e-5d98-46ef-a71c-82fe4de8bb72 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:40.471805 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b340773e-5d98-46ef-a71c-82fe4de8bb72 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:40.478574 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b340773e-5d98-46ef-a71c-82fe4de8bb72 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:40.479073 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b340773e-5d98-46ef-a71c-82fe4de8bb72 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:40.479994 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b340773e-5d98-46ef-a71c-82fe4de8bb72 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:40.480421 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b340773e-5d98-46ef-a71c-82fe4de8bb72 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:40.538483 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-926262f0-3840-4039-bf21-d17cd991f782 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:40.550169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-926262f0-3840-4039-bf21-d17cd991f782 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1298 microversion: 2.1 time: 0.106159 Jul 12 07:13:40.550896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 41/72] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:40 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:13:40.642909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b340773e-5d98-46ef-a71c-82fe4de8bb72 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:40.654808 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b340773e-5d98-46ef-a71c-82fe4de8bb72 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.188382 Jul 12 07:13:40.655597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 32/73] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:40 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:13:41.006477 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5a84fae7-c6dc-461b-af8b-8aab70892ddb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:41.007234 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5a84fae7-c6dc-461b-af8b-8aab70892ddb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:41.016469 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a84fae7-c6dc-461b-af8b-8aab70892ddb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:41.017099 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a84fae7-c6dc-461b-af8b-8aab70892ddb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:41.019740 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a84fae7-c6dc-461b-af8b-8aab70892ddb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:41.022392 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5a84fae7-c6dc-461b-af8b-8aab70892ddb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:41.158569 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:41.159312 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:41.169643 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:41.172611 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:41.173582 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:41.174040 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:41.956766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5a84fae7-c6dc-461b-af8b-8aab70892ddb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:41.968859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5a84fae7-c6dc-461b-af8b-8aab70892ddb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.968837 Jul 12 07:13:41.969545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 42/74] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:40 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:41.977730 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0707caf0-2262-4056-9f52-844d2b333e12 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:41.979768 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0707caf0-2262-4056-9f52-844d2b333e12 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:42.012566 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0707caf0-2262-4056-9f52-844d2b333e12 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:42.014142 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0707caf0-2262-4056-9f52-844d2b333e12 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:42.015221 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0707caf0-2262-4056-9f52-844d2b333e12 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:42.017587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0707caf0-2262-4056-9f52-844d2b333e12 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:42.023713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:42.032294 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:42.036820 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:42.042934 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f68ea61c-a50d-4439-b18a-1c022a014af8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.889642 Jul 12 07:13:42.044017 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 33/75] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:41 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:42.049160 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8844f5f0-4cb6-4b9b-9956-5dd76adb531d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:42.061974 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8844f5f0-4cb6-4b9b-9956-5dd76adb531d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:42.068859 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8844f5f0-4cb6-4b9b-9956-5dd76adb531d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:42.069544 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8844f5f0-4cb6-4b9b-9956-5dd76adb531d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:42.070472 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8844f5f0-4cb6-4b9b-9956-5dd76adb531d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:42.071096 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8844f5f0-4cb6-4b9b-9956-5dd76adb531d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:42.282075 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8844f5f0-4cb6-4b9b-9956-5dd76adb531d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:42.292271 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8844f5f0-4cb6-4b9b-9956-5dd76adb531d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1298 microversion: 2.1 time: 0.246960 Jul 12 07:13:42.294891 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 34/76] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:42 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1298 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:42.309488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8ad49d7a-8b2b-4cf5-9e50-fc98c9c7e6bc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:42.310854 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8ad49d7a-8b2b-4cf5-9e50-fc98c9c7e6bc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:42.327548 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ad49d7a-8b2b-4cf5-9e50-fc98c9c7e6bc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:42.329276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ad49d7a-8b2b-4cf5-9e50-fc98c9c7e6bc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:42.330534 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ad49d7a-8b2b-4cf5-9e50-fc98c9c7e6bc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:42.333024 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ad49d7a-8b2b-4cf5-9e50-fc98c9c7e6bc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:42.404867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0707caf0-2262-4056-9f52-844d2b333e12 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:42.420355 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0707caf0-2262-4056-9f52-844d2b333e12 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.449408 Jul 12 07:13:42.421266 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 43/77] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:41 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:42.442442 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-5715810c-d09b-42ae-8369-67377017e828 req-72043ba5-8294-425b-98e6-c8c47161b3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eae86e1-220e-41f6-9b8d-7b5a224f7a89", "tag": "7382a006-1c5b-424d-a60a-2f13d664f229"}, {"name": "network-changed", "server_uuid": "aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7", "tag": "eab59db7-2167-4352-a4bb-fb23a341c8a3"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:42.462301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5715810c-d09b-42ae-8369-67377017e828 req-72043ba5-8294-425b-98e6-c8c47161b3d5 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:42.463973 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5715810c-d09b-42ae-8369-67377017e828 req-72043ba5-8294-425b-98e6-c8c47161b3d5 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:42.480720 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-5715810c-d09b-42ae-8369-67377017e828 req-72043ba5-8294-425b-98e6-c8c47161b3d5 service nova] Creating event network-changed:7382a006-1c5b-424d-a60a-2f13d664f229 for instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 on hv-cinder-82549 Jul 12 07:13:42.487137 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-5715810c-d09b-42ae-8369-67377017e828 req-72043ba5-8294-425b-98e6-c8c47161b3d5 service nova] Creating event network-changed:eab59db7-2167-4352-a4bb-fb23a341c8a3 for instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 on hv-cinder-82549 Jul 12 07:13:42.495471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-5715810c-d09b-42ae-8369-67377017e828 req-72043ba5-8294-425b-98e6-c8c47161b3d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072835 Jul 12 07:13:42.497128 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 44/78] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:42.544488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8ad49d7a-8b2b-4cf5-9e50-fc98c9c7e6bc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:42.552813 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8ad49d7a-8b2b-4cf5-9e50-fc98c9c7e6bc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.254833 Jul 12 07:13:42.554325 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 35/79] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:42 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:42.986328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8c5325fd-33f9-4053-9e8b-9a77507bff17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:42.993318 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8c5325fd-33f9-4053-9e8b-9a77507bff17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:43.005616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c5325fd-33f9-4053-9e8b-9a77507bff17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.005616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c5325fd-33f9-4053-9e8b-9a77507bff17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.006363 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c5325fd-33f9-4053-9e8b-9a77507bff17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.006827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c5325fd-33f9-4053-9e8b-9a77507bff17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.067146 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:43.068487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:43.075515 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.076097 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.076857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.077459 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.245383 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8c5325fd-33f9-4053-9e8b-9a77507bff17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:43.255469 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8c5325fd-33f9-4053-9e8b-9a77507bff17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.272641 Jul 12 07:13:43.256393 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 45/80] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:42 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:43.276988 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:43.288036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:43.289577 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:43.290692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78caedf9-5b0a-4f9d-b82b-7d844536d461 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.232240 Jul 12 07:13:43.291247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 36/81] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:43 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:43.311278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d87dd982-d443-443a-a539-f37d34ae2624 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:43.312001 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d87dd982-d443-443a-a539-f37d34ae2624 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:43.335803 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d87dd982-d443-443a-a539-f37d34ae2624 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.336359 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d87dd982-d443-443a-a539-f37d34ae2624 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.339810 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d87dd982-d443-443a-a539-f37d34ae2624 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.340395 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d87dd982-d443-443a-a539-f37d34ae2624 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.440273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dc42737e-e782-4285-9ad6-f16d8153c9b8 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:43.440762 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dc42737e-e782-4285-9ad6-f16d8153c9b8 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:43.449229 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc42737e-e782-4285-9ad6-f16d8153c9b8 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.449992 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc42737e-e782-4285-9ad6-f16d8153c9b8 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.450928 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc42737e-e782-4285-9ad6-f16d8153c9b8 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.451676 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc42737e-e782-4285-9ad6-f16d8153c9b8 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.536592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d87dd982-d443-443a-a539-f37d34ae2624 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:43.553433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d87dd982-d443-443a-a539-f37d34ae2624 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.246183 Jul 12 07:13:43.554502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 46/82] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:43 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:43.572791 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-196f5db0-b103-4bf8-a25c-ba7a30a7cab2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:43.573748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-196f5db0-b103-4bf8-a25c-ba7a30a7cab2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:43.584651 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-196f5db0-b103-4bf8-a25c-ba7a30a7cab2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.585120 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-196f5db0-b103-4bf8-a25c-ba7a30a7cab2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.586061 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-196f5db0-b103-4bf8-a25c-ba7a30a7cab2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:43.587352 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-196f5db0-b103-4bf8-a25c-ba7a30a7cab2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:43.658266 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dc42737e-e782-4285-9ad6-f16d8153c9b8 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:43.669590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dc42737e-e782-4285-9ad6-f16d8153c9b8 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.234105 Jul 12 07:13:43.670178 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 37/83] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:43 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:43.760442 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-196f5db0-b103-4bf8-a25c-ba7a30a7cab2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:43.768849 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-196f5db0-b103-4bf8-a25c-ba7a30a7cab2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.202506 Jul 12 07:13:43.769499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 47/84] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:43 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:44.274748 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b4c6002d-5ce7-4a6b-b582-7d17645ceb11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:44.276308 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b4c6002d-5ce7-4a6b-b582-7d17645ceb11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:44.285187 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4c6002d-5ce7-4a6b-b582-7d17645ceb11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:44.285636 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4c6002d-5ce7-4a6b-b582-7d17645ceb11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:44.286425 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4c6002d-5ce7-4a6b-b582-7d17645ceb11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:44.286869 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4c6002d-5ce7-4a6b-b582-7d17645ceb11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:44.318911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:44.320305 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:44.330130 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:44.333062 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:44.334128 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:44.334759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:44.672868 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:44.675305 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b4c6002d-5ce7-4a6b-b582-7d17645ceb11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:44.678813 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:44.684167 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b4c6002d-5ce7-4a6b-b582-7d17645ceb11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.415760 Jul 12 07:13:44.691892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:44.695141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 38/85] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:44 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:44.701155 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-0b456edf-2b12-4867-815a-8d6c494d5343 req-f70e2ce6-2cc5-4cb8-9b5d-d9c2cb43283a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99231ef-ba9f-4294-87ab-e47992b4f001", "tag": "ad507e7e-5574-4340-9b10-2c7fbbf7fb11"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:44.710649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:44.711644 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-0b456edf-2b12-4867-815a-8d6c494d5343 req-f70e2ce6-2cc5-4cb8-9b5d-d9c2cb43283a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:44.712222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-0b456edf-2b12-4867-815a-8d6c494d5343 req-f70e2ce6-2cc5-4cb8-9b5d-d9c2cb43283a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:44.715590 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6f524fe8-58da-4b81-ab5c-f88246e9b9b6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.407578 Jul 12 07:13:44.716674 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 48/86] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:44 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:44.732049 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d6a18b46-657b-47a5-a51c-149ba710f1df tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:44.733586 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d6a18b46-657b-47a5-a51c-149ba710f1df tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:44.734305 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-0b456edf-2b12-4867-815a-8d6c494d5343 req-f70e2ce6-2cc5-4cb8-9b5d-d9c2cb43283a service nova] Creating event network-changed:ad507e7e-5574-4340-9b10-2c7fbbf7fb11 for instance e99231ef-ba9f-4294-87ab-e47992b4f001 on hv-cinder-82549 Jul 12 07:13:44.747340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-0b456edf-2b12-4867-815a-8d6c494d5343 req-f70e2ce6-2cc5-4cb8-9b5d-d9c2cb43283a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048237 Jul 12 07:13:44.749025 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 39/87] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:44.756370 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6a18b46-657b-47a5-a51c-149ba710f1df tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:44.757185 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6a18b46-657b-47a5-a51c-149ba710f1df tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:44.758603 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6a18b46-657b-47a5-a51c-149ba710f1df tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:44.760404 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6a18b46-657b-47a5-a51c-149ba710f1df tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:44.760615 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ff745f9e-6aad-4453-8632-23c954173d56 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:44.761343 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ff745f9e-6aad-4453-8632-23c954173d56 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:44.775037 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff745f9e-6aad-4453-8632-23c954173d56 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:44.775657 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff745f9e-6aad-4453-8632-23c954173d56 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:44.776550 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff745f9e-6aad-4453-8632-23c954173d56 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:44.777154 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff745f9e-6aad-4453-8632-23c954173d56 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:45.030127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ff745f9e-6aad-4453-8632-23c954173d56 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:45.034544 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d6a18b46-657b-47a5-a51c-149ba710f1df tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:45.038291 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ff745f9e-6aad-4453-8632-23c954173d56 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.283956 Jul 12 07:13:45.038858 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 40/88] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:44 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:45.046085 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e57433c-c504-4589-bb3f-807c41bf7992 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:45.046085 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2e57433c-c504-4589-bb3f-807c41bf7992 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:45.052928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d6a18b46-657b-47a5-a51c-149ba710f1df tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.334144 Jul 12 07:13:45.053848 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 49/89] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:44 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:45.072403 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e57433c-c504-4589-bb3f-807c41bf7992 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:45.072983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e57433c-c504-4589-bb3f-807c41bf7992 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:45.073881 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e57433c-c504-4589-bb3f-807c41bf7992 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:45.074289 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e57433c-c504-4589-bb3f-807c41bf7992 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:45.283924 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2e57433c-c504-4589-bb3f-807c41bf7992 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:45.291767 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e57433c-c504-4589-bb3f-807c41bf7992 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.251920 Jul 12 07:13:45.292628 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 41/90] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:45 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:45.702362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-26b565c8-b60a-4ede-8f64-948453182e9e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:45.702963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-26b565c8-b60a-4ede-8f64-948453182e9e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:45.709357 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26b565c8-b60a-4ede-8f64-948453182e9e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:45.709788 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26b565c8-b60a-4ede-8f64-948453182e9e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:45.710537 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26b565c8-b60a-4ede-8f64-948453182e9e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:45.710963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-26b565c8-b60a-4ede-8f64-948453182e9e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:45.733719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:45.734657 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:45.743690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:45.744212 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:45.745177 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:45.745763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:45.901895 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-26b565c8-b60a-4ede-8f64-948453182e9e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:45.910820 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-26b565c8-b60a-4ede-8f64-948453182e9e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.212316 Jul 12 07:13:45.911578 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 50/91] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:45 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:45.929912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:45.938293 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:45.939954 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:45.941255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0892ffd4-6378-47b2-9d1a-ba211587764a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.211631 Jul 12 07:13:45.941886 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 42/92] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:45 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:46.055684 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fe83ab26-05a6-4527-85dd-f971dce00d9c tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:46.056443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fe83ab26-05a6-4527-85dd-f971dce00d9c tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:46.063071 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fe83ab26-05a6-4527-85dd-f971dce00d9c tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.063516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fe83ab26-05a6-4527-85dd-f971dce00d9c tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:46.064284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fe83ab26-05a6-4527-85dd-f971dce00d9c tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.064992 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fe83ab26-05a6-4527-85dd-f971dce00d9c tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:46.070045 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-571f3dfa-05d6-4666-a907-d0eb5a38e2e5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:46.070911 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-571f3dfa-05d6-4666-a907-d0eb5a38e2e5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:46.077354 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-571f3dfa-05d6-4666-a907-d0eb5a38e2e5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.077902 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-571f3dfa-05d6-4666-a907-d0eb5a38e2e5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:46.078755 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-571f3dfa-05d6-4666-a907-d0eb5a38e2e5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.079246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-571f3dfa-05d6-4666-a907-d0eb5a38e2e5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:46.275515 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fe83ab26-05a6-4527-85dd-f971dce00d9c tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:46.284030 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fe83ab26-05a6-4527-85dd-f971dce00d9c tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.232015 Jul 12 07:13:46.285075 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 51/93] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:46 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:46.285360 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-571f3dfa-05d6-4666-a907-d0eb5a38e2e5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:46.293364 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-571f3dfa-05d6-4666-a907-d0eb5a38e2e5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.227319 Jul 12 07:13:46.294206 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 43/94] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:46 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:46.310357 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-15170f1a-fd54-470b-8318-bf6e7ac0f9e5 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:46.310804 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-15170f1a-fd54-470b-8318-bf6e7ac0f9e5 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:46.317076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-15170f1a-fd54-470b-8318-bf6e7ac0f9e5 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.317515 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-15170f1a-fd54-470b-8318-bf6e7ac0f9e5 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:46.318263 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-15170f1a-fd54-470b-8318-bf6e7ac0f9e5 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.318684 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-15170f1a-fd54-470b-8318-bf6e7ac0f9e5 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:46.451926 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:46.458160 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-15170f1a-fd54-470b-8318-bf6e7ac0f9e5 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:46.465534 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-15170f1a-fd54-470b-8318-bf6e7ac0f9e5 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.159995 Jul 12 07:13:46.466120 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 52/95] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:46 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:46.927715 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f9b4d643-0dc7-42a2-9298-79dca414f025 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:46.928308 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f9b4d643-0dc7-42a2-9298-79dca414f025 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:46.934306 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9b4d643-0dc7-42a2-9298-79dca414f025 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.934739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9b4d643-0dc7-42a2-9298-79dca414f025 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:46.935471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9b4d643-0dc7-42a2-9298-79dca414f025 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.935905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9b4d643-0dc7-42a2-9298-79dca414f025 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:46.960236 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:46.961144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:46.967851 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.968630 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:46.969443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:46.969874 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:47.029095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=30 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:47.123599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f9b4d643-0dc7-42a2-9298-79dca414f025 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:47.132231 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f9b4d643-0dc7-42a2-9298-79dca414f025 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.208272 Jul 12 07:13:47.132915 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 44/96] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:46 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:47.149574 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:47.157770 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:47.159362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:47.160515 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5bd2014e-f5ce-4f0c-8fd7-d2f60d8374b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.204273 Jul 12 07:13:47.161175 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 53/97] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:46 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:47.302038 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9fd2b453-8d29-465b-b584-ae022f4202db tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:47.302675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9fd2b453-8d29-465b-b584-ae022f4202db tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:47.309114 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fd2b453-8d29-465b-b584-ae022f4202db tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:47.309508 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fd2b453-8d29-465b-b584-ae022f4202db tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:47.310386 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fd2b453-8d29-465b-b584-ae022f4202db tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:47.310819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fd2b453-8d29-465b-b584-ae022f4202db tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:47.314746 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bb9f63f0-318f-4e93-abcf-6de35a622bd7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:47.314746 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bb9f63f0-318f-4e93-abcf-6de35a622bd7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:47.321155 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bb9f63f0-318f-4e93-abcf-6de35a622bd7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:47.321649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bb9f63f0-318f-4e93-abcf-6de35a622bd7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:47.322502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bb9f63f0-318f-4e93-abcf-6de35a622bd7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:47.323013 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bb9f63f0-318f-4e93-abcf-6de35a622bd7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:47.521516 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9fd2b453-8d29-465b-b584-ae022f4202db tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:47.526519 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bb9f63f0-318f-4e93-abcf-6de35a622bd7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:47.536873 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9fd2b453-8d29-465b-b584-ae022f4202db tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.239133 Jul 12 07:13:47.546492 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bb9f63f0-318f-4e93-abcf-6de35a622bd7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.228095 Jul 12 07:13:47.546694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 45/98] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:47 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:47.546790 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 54/99] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:47 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:13:47.546879 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6e84844e-80c2-4e60-8545-06d84e6d95b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:47.546879 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6e84844e-80c2-4e60-8545-06d84e6d95b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:47.549461 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e84844e-80c2-4e60-8545-06d84e6d95b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:47.550003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e84844e-80c2-4e60-8545-06d84e6d95b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:47.550752 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e84844e-80c2-4e60-8545-06d84e6d95b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:47.551177 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e84844e-80c2-4e60-8545-06d84e6d95b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:47.684159 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6e84844e-80c2-4e60-8545-06d84e6d95b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:47.692073 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6e84844e-80c2-4e60-8545-06d84e6d95b3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.153194 Jul 12 07:13:47.692626 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 46/100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:47 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:48.149876 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bdaa5d9e-4802-4403-a9e4-8741c20ac6b2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:48.150539 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bdaa5d9e-4802-4403-a9e4-8741c20ac6b2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:48.160300 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bdaa5d9e-4802-4403-a9e4-8741c20ac6b2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:48.164518 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bdaa5d9e-4802-4403-a9e4-8741c20ac6b2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:48.165697 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bdaa5d9e-4802-4403-a9e4-8741c20ac6b2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:48.166313 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bdaa5d9e-4802-4403-a9e4-8741c20ac6b2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:48.178867 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:48.179712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:48.197028 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:48.197550 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:48.198268 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:48.198690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:48.800338 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bdaa5d9e-4802-4403-a9e4-8741c20ac6b2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:48.810790 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bdaa5d9e-4802-4403-a9e4-8741c20ac6b2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.665000 Jul 12 07:13:48.816346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 55/101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:48 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:48.830310 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bbc54453-1d9e-445d-aa1c-58414625feb3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:48.832832 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bbc54453-1d9e-445d-aa1c-58414625feb3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:48.848967 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bbc54453-1d9e-445d-aa1c-58414625feb3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:48.850918 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bbc54453-1d9e-445d-aa1c-58414625feb3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:48.855184 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bbc54453-1d9e-445d-aa1c-58414625feb3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:48.856805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bbc54453-1d9e-445d-aa1c-58414625feb3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:48.859814 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:48.873855 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:48.878531 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:48.880981 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-55d8904c-701a-4a35-ad1b-061cf2f4274a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.706023 Jul 12 07:13:48.896551 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 47/102] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:48 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:13:48.907956 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1e92d2a9-0655-4385-a864-812fdacc6a31 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:48.910765 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1e92d2a9-0655-4385-a864-812fdacc6a31 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:48.930266 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e92d2a9-0655-4385-a864-812fdacc6a31 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:48.930851 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e92d2a9-0655-4385-a864-812fdacc6a31 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:48.932528 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e92d2a9-0655-4385-a864-812fdacc6a31 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:48.933074 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e92d2a9-0655-4385-a864-812fdacc6a31 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:49.329306 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bbc54453-1d9e-445d-aa1c-58414625feb3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:49.339495 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bbc54453-1d9e-445d-aa1c-58414625feb3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.521646 Jul 12 07:13:49.350160 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 56/103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:48 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:49.363131 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1e92d2a9-0655-4385-a864-812fdacc6a31 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:49.376143 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1e92d2a9-0655-4385-a864-812fdacc6a31 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.476298 Jul 12 07:13:49.376657 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 48/104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:48 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:49.391892 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f3f00465-573e-4d95-b0bb-302e7105243c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:49.392520 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f3f00465-573e-4d95-b0bb-302e7105243c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:49.400099 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3f00465-573e-4d95-b0bb-302e7105243c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:49.402452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3f00465-573e-4d95-b0bb-302e7105243c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:49.405212 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3f00465-573e-4d95-b0bb-302e7105243c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:49.406635 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3f00465-573e-4d95-b0bb-302e7105243c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:49.448869 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-3762e36d-c307-4ba0-a89b-7ceefba61f74 req-0d2d3c89-48f9-45d9-87b1-ecfc0e4a6edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dba59c-e816-486d-9296-9fcd6e5a51ff", "name": "network-vif-plugged", "status": "completed", "tag": "e091627f-3767-4ff2-9414-c9935125f0fb"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:49.463412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3762e36d-c307-4ba0-a89b-7ceefba61f74 req-0d2d3c89-48f9-45d9-87b1-ecfc0e4a6edf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:49.463918 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-3762e36d-c307-4ba0-a89b-7ceefba61f74 req-0d2d3c89-48f9-45d9-87b1-ecfc0e4a6edf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:49.489511 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-3762e36d-c307-4ba0-a89b-7ceefba61f74 req-0d2d3c89-48f9-45d9-87b1-ecfc0e4a6edf service nova] Creating event network-vif-plugged:e091627f-3767-4ff2-9414-c9935125f0fb for instance e1dba59c-e816-486d-9296-9fcd6e5a51ff on hv-cinder-82549 Jul 12 07:13:49.500504 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-3762e36d-c307-4ba0-a89b-7ceefba61f74 req-0d2d3c89-48f9-45d9-87b1-ecfc0e4a6edf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148770 Jul 12 07:13:49.503543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 57/105] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:49.648900 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f3f00465-573e-4d95-b0bb-302e7105243c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:49.666106 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f3f00465-573e-4d95-b0bb-302e7105243c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.287676 Jul 12 07:13:49.667980 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 49/106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:49 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:49.833194 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b972ddac-8b8a-4cc8-a3c4-92896eca2bbd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:49.833881 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b972ddac-8b8a-4cc8-a3c4-92896eca2bbd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:49.840515 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b972ddac-8b8a-4cc8-a3c4-92896eca2bbd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:49.840958 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b972ddac-8b8a-4cc8-a3c4-92896eca2bbd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:49.841844 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b972ddac-8b8a-4cc8-a3c4-92896eca2bbd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:49.842254 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b972ddac-8b8a-4cc8-a3c4-92896eca2bbd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:49.860006 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:49.900130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:49.900705 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:49.906876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:49.907331 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:49.908085 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:49.908577 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:50.024030 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b972ddac-8b8a-4cc8-a3c4-92896eca2bbd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:50.032215 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b972ddac-8b8a-4cc8-a3c4-92896eca2bbd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.203357 Jul 12 07:13:50.032806 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 58/107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:49 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:50.070366 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:50.078663 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:50.080199 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:50.081664 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2552c04c-9759-4955-bd50-4ca26622b557 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.185586 Jul 12 07:13:50.082243 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 50/108] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:49 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:13:50.366888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a25847cd-8a8a-4515-8063-b2f3194b027d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:50.367502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a25847cd-8a8a-4515-8063-b2f3194b027d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:50.374088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a25847cd-8a8a-4515-8063-b2f3194b027d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:50.374530 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a25847cd-8a8a-4515-8063-b2f3194b027d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:50.375330 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a25847cd-8a8a-4515-8063-b2f3194b027d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:50.375743 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a25847cd-8a8a-4515-8063-b2f3194b027d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:50.393487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4342200f-ba76-4c25-aa94-6f5c468c538e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:50.394197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4342200f-ba76-4c25-aa94-6f5c468c538e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:50.396742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=8 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:50.403664 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4342200f-ba76-4c25-aa94-6f5c468c538e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:50.404123 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4342200f-ba76-4c25-aa94-6f5c468c538e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:50.404906 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4342200f-ba76-4c25-aa94-6f5c468c538e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:50.405339 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4342200f-ba76-4c25-aa94-6f5c468c538e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:50.582273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4342200f-ba76-4c25-aa94-6f5c468c538e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:50.585597 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a25847cd-8a8a-4515-8063-b2f3194b027d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:50.593719 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a25847cd-8a8a-4515-8063-b2f3194b027d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.230502 Jul 12 07:13:50.594292 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 59/109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:50 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:50.594433 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4342200f-ba76-4c25-aa94-6f5c468c538e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.205572 Jul 12 07:13:50.594934 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 51/110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:50 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:50.690393 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ecbd1ec1-34cf-4cee-accc-61764e61b480 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:50.691450 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ecbd1ec1-34cf-4cee-accc-61764e61b480 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:50.702020 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ecbd1ec1-34cf-4cee-accc-61764e61b480 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:50.702703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ecbd1ec1-34cf-4cee-accc-61764e61b480 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:50.703934 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ecbd1ec1-34cf-4cee-accc-61764e61b480 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:50.704635 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ecbd1ec1-34cf-4cee-accc-61764e61b480 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:50.839968 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ecbd1ec1-34cf-4cee-accc-61764e61b480 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:50.849980 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ecbd1ec1-34cf-4cee-accc-61764e61b480 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.166296 Jul 12 07:13:50.850561 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 60/111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:50 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:51.052986 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e23bb605-b4c8-4819-ba88-f8a2469ff919 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:51.053843 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e23bb605-b4c8-4819-ba88-f8a2469ff919 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:51.062180 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e23bb605-b4c8-4819-ba88-f8a2469ff919 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.062767 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e23bb605-b4c8-4819-ba88-f8a2469ff919 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:51.063766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e23bb605-b4c8-4819-ba88-f8a2469ff919 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.064583 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e23bb605-b4c8-4819-ba88-f8a2469ff919 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:51.099681 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:51.100340 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:51.106940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.107377 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:51.108127 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.108551 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:51.241280 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e23bb605-b4c8-4819-ba88-f8a2469ff919 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:51.249080 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e23bb605-b4c8-4819-ba88-f8a2469ff919 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.201279 Jul 12 07:13:51.249658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 52/112] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:51 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:51.271364 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:51.279786 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:51.281317 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:51.282428 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0bc8cb13-807d-4547-a5fe-db26ff187f26 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.186703 Jul 12 07:13:51.283000 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 61/113] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:51 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:51.609826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2649f6fa-fadf-4211-b4ea-3002e5868c36 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:51.610460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2649f6fa-fadf-4211-b4ea-3002e5868c36 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:51.611156 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e35f2689-028f-4fe9-8e2f-60906bf1a206 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:51.612270 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e35f2689-028f-4fe9-8e2f-60906bf1a206 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:51.617308 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2649f6fa-fadf-4211-b4ea-3002e5868c36 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.617769 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2649f6fa-fadf-4211-b4ea-3002e5868c36 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:51.618519 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2649f6fa-fadf-4211-b4ea-3002e5868c36 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.618940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2649f6fa-fadf-4211-b4ea-3002e5868c36 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:51.619044 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e35f2689-028f-4fe9-8e2f-60906bf1a206 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.619499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e35f2689-028f-4fe9-8e2f-60906bf1a206 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:51.620248 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e35f2689-028f-4fe9-8e2f-60906bf1a206 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.620678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e35f2689-028f-4fe9-8e2f-60906bf1a206 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:51.839121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2649f6fa-fadf-4211-b4ea-3002e5868c36 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:51.842451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e35f2689-028f-4fe9-8e2f-60906bf1a206 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:51.847460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2649f6fa-fadf-4211-b4ea-3002e5868c36 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.241613 Jul 12 07:13:51.848221 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 53/114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:51 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:51.850400 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e35f2689-028f-4fe9-8e2f-60906bf1a206 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.243331 Jul 12 07:13:51.850985 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 62/115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:51 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:51.866512 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-85c2ca8c-c3d7-4188-ad34-b690ad593ab7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:51.867115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-85c2ca8c-c3d7-4188-ad34-b690ad593ab7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:51.873334 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85c2ca8c-c3d7-4188-ad34-b690ad593ab7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.873778 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85c2ca8c-c3d7-4188-ad34-b690ad593ab7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:51.874523 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85c2ca8c-c3d7-4188-ad34-b690ad593ab7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:51.874954 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85c2ca8c-c3d7-4188-ad34-b690ad593ab7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:52.022951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-85c2ca8c-c3d7-4188-ad34-b690ad593ab7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:52.030755 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-85c2ca8c-c3d7-4188-ad34-b690ad593ab7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.167987 Jul 12 07:13:52.031335 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 54/116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:51 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:52.270289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-99530893-1fc7-418a-997c-d36a67aba546 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:52.270893 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-99530893-1fc7-418a-997c-d36a67aba546 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:52.277451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99530893-1fc7-418a-997c-d36a67aba546 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:52.277898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99530893-1fc7-418a-997c-d36a67aba546 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:52.278673 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99530893-1fc7-418a-997c-d36a67aba546 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:52.279109 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99530893-1fc7-418a-997c-d36a67aba546 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:52.302300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:52.302856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:52.309393 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:52.309820 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:52.310803 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:52.311236 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:52.479717 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-99530893-1fc7-418a-997c-d36a67aba546 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:52.488100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-99530893-1fc7-418a-997c-d36a67aba546 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.223737 Jul 12 07:13:52.489452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 63/117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:52 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:52.504619 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:52.513431 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:52.514970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:52.516149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b801ff15-4d9d-4414-9079-45acbc1bf46e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.218650 Jul 12 07:13:52.516741 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 55/118] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:52 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:52.864908 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-915ae619-669c-4c28-8bdd-344a95a29a2e tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:52.865503 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-915ae619-669c-4c28-8bdd-344a95a29a2e tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:52.867925 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d8d830e-0080-487d-9012-f77948e3066a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:52.868899 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d8d830e-0080-487d-9012-f77948e3066a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:52.870946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:52.872468 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-915ae619-669c-4c28-8bdd-344a95a29a2e tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:52.872987 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-915ae619-669c-4c28-8bdd-344a95a29a2e tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:52.874092 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-915ae619-669c-4c28-8bdd-344a95a29a2e tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:52.874458 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-915ae619-669c-4c28-8bdd-344a95a29a2e tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:52.876157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d8d830e-0080-487d-9012-f77948e3066a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:52.876567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d8d830e-0080-487d-9012-f77948e3066a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:52.877602 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d8d830e-0080-487d-9012-f77948e3066a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:52.878006 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d8d830e-0080-487d-9012-f77948e3066a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:52.884183 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:53.066706 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-915ae619-669c-4c28-8bdd-344a95a29a2e tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:53.070015 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d8d830e-0080-487d-9012-f77948e3066a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:53.074643 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-915ae619-669c-4c28-8bdd-344a95a29a2e tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.213884 Jul 12 07:13:53.075300 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 64/119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:52 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:53.077718 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d8d830e-0080-487d-9012-f77948e3066a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.213854 Jul 12 07:13:53.078283 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 56/120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:52 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:53.080273 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d9f061d6-1dda-4054-a804-8cc134215691 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:53.080871 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d9f061d6-1dda-4054-a804-8cc134215691 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:53.086865 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d9f061d6-1dda-4054-a804-8cc134215691 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:53.087265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d9f061d6-1dda-4054-a804-8cc134215691 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:53.088040 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d9f061d6-1dda-4054-a804-8cc134215691 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:53.088466 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d9f061d6-1dda-4054-a804-8cc134215691 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:53.221342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d9f061d6-1dda-4054-a804-8cc134215691 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:53.228937 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d9f061d6-1dda-4054-a804-8cc134215691 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.152559 Jul 12 07:13:53.229538 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 65/121] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:53 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:53.505852 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1096cca2-7ea7-4ea2-ac6f-a4898b4c1f1f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:53.506460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1096cca2-7ea7-4ea2-ac6f-a4898b4c1f1f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:53.512802 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1096cca2-7ea7-4ea2-ac6f-a4898b4c1f1f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:53.513353 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1096cca2-7ea7-4ea2-ac6f-a4898b4c1f1f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:53.514203 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1096cca2-7ea7-4ea2-ac6f-a4898b4c1f1f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:53.514696 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1096cca2-7ea7-4ea2-ac6f-a4898b4c1f1f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:53.534791 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:53.535482 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:53.541754 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:53.542217 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:53.542941 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:53.543567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:53.722658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1096cca2-7ea7-4ea2-ac6f-a4898b4c1f1f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:53.730093 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1096cca2-7ea7-4ea2-ac6f-a4898b4c1f1f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.228549 Jul 12 07:13:53.730660 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 57/122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:53 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:53.747425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:53.756028 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:53.757542 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:53.758632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-04b03433-85d6-4ef3-9754-233227b79d93 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.228276 Jul 12 07:13:53.759188 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 66/123] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:53 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:13:54.096320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eb5c4d55-8b03-4f98-8990-07f7fb8070cb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:54.097103 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eb5c4d55-8b03-4f98-8990-07f7fb8070cb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:54.098204 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-83a9e031-489a-41db-9bea-40a26b99f67b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:54.098774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-83a9e031-489a-41db-9bea-40a26b99f67b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:54.103992 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb5c4d55-8b03-4f98-8990-07f7fb8070cb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.104559 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb5c4d55-8b03-4f98-8990-07f7fb8070cb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.104960 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83a9e031-489a-41db-9bea-40a26b99f67b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.105440 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83a9e031-489a-41db-9bea-40a26b99f67b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.105567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb5c4d55-8b03-4f98-8990-07f7fb8070cb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.105917 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb5c4d55-8b03-4f98-8990-07f7fb8070cb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.106192 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83a9e031-489a-41db-9bea-40a26b99f67b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.106615 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83a9e031-489a-41db-9bea-40a26b99f67b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.298036 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-83a9e031-489a-41db-9bea-40a26b99f67b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:54.302061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eb5c4d55-8b03-4f98-8990-07f7fb8070cb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:54.305930 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-83a9e031-489a-41db-9bea-40a26b99f67b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.213619 Jul 12 07:13:54.306533 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 67/124] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:54 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:54.310034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eb5c4d55-8b03-4f98-8990-07f7fb8070cb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.220177 Jul 12 07:13:54.310742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 58/125] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:54 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:54.311174 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6c966d1d-f398-4f5d-9225-90f90f0b0fbc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:54.311842 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6c966d1d-f398-4f5d-9225-90f90f0b0fbc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:54.317963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c966d1d-f398-4f5d-9225-90f90f0b0fbc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.318408 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c966d1d-f398-4f5d-9225-90f90f0b0fbc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.319184 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c966d1d-f398-4f5d-9225-90f90f0b0fbc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.319610 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c966d1d-f398-4f5d-9225-90f90f0b0fbc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.451844 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6c966d1d-f398-4f5d-9225-90f90f0b0fbc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:54.459908 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6c966d1d-f398-4f5d-9225-90f90f0b0fbc tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.152410 Jul 12 07:13:54.460477 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 68/126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:54 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:54.747895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7c8510f2-ac15-432e-b127-804b1d5806e1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:54.748465 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7c8510f2-ac15-432e-b127-804b1d5806e1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:54.755111 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c8510f2-ac15-432e-b127-804b1d5806e1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.755551 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c8510f2-ac15-432e-b127-804b1d5806e1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.756294 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c8510f2-ac15-432e-b127-804b1d5806e1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.756720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c8510f2-ac15-432e-b127-804b1d5806e1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.777513 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:54.778484 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:54.786900 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.787342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.788102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:54.788530 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:54.943886 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7c8510f2-ac15-432e-b127-804b1d5806e1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:54.951615 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7c8510f2-ac15-432e-b127-804b1d5806e1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.207510 Jul 12 07:13:54.952252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 59/127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:54 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:54.973814 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:54.982030 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:54.983515 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:54.984614 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-208da973-941f-4c8a-bd2b-14e7716b045d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.212785 Jul 12 07:13:54.985181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 69/128] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:54 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:55.326802 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2035d161-620a-4852-858f-8f4479afe2da tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:55.327712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2035d161-620a-4852-858f-8f4479afe2da tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:55.331647 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8a6d1a74-1abf-4cfc-9b51-fca334cdd62a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:55.332646 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8a6d1a74-1abf-4cfc-9b51-fca334cdd62a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:55.337969 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2035d161-620a-4852-858f-8f4479afe2da tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:55.338700 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2035d161-620a-4852-858f-8f4479afe2da tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:55.339923 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2035d161-620a-4852-858f-8f4479afe2da tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:55.340625 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2035d161-620a-4852-858f-8f4479afe2da tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:55.342358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a6d1a74-1abf-4cfc-9b51-fca334cdd62a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:55.343096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a6d1a74-1abf-4cfc-9b51-fca334cdd62a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:55.344360 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a6d1a74-1abf-4cfc-9b51-fca334cdd62a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:55.345091 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a6d1a74-1abf-4cfc-9b51-fca334cdd62a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:55.538452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2035d161-620a-4852-858f-8f4479afe2da tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:55.541784 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8a6d1a74-1abf-4cfc-9b51-fca334cdd62a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:55.546388 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2035d161-620a-4852-858f-8f4479afe2da tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.226199 Jul 12 07:13:55.547047 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 60/129] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:55 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:55.550090 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8a6d1a74-1abf-4cfc-9b51-fca334cdd62a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.225758 Jul 12 07:13:55.550748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 70/130] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:55 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:55.551459 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5893d69b-ba6b-4835-b3da-e11aedcda730 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:55.552046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5893d69b-ba6b-4835-b3da-e11aedcda730 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:55.558267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5893d69b-ba6b-4835-b3da-e11aedcda730 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:55.558704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5893d69b-ba6b-4835-b3da-e11aedcda730 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:55.559563 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5893d69b-ba6b-4835-b3da-e11aedcda730 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:55.559882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5893d69b-ba6b-4835-b3da-e11aedcda730 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:55.692957 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5893d69b-ba6b-4835-b3da-e11aedcda730 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:55.700625 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5893d69b-ba6b-4835-b3da-e11aedcda730 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.152645 Jul 12 07:13:55.701215 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 61/131] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:55 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:55.967844 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b09d3c8f-3d10-4889-b1e4-9a07c19bf6ac tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:55.968465 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b09d3c8f-3d10-4889-b1e4-9a07c19bf6ac tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:55.975086 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b09d3c8f-3d10-4889-b1e4-9a07c19bf6ac tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:55.975505 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b09d3c8f-3d10-4889-b1e4-9a07c19bf6ac tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:55.976251 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b09d3c8f-3d10-4889-b1e4-9a07c19bf6ac tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:55.976669 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b09d3c8f-3d10-4889-b1e4-9a07c19bf6ac tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:56.003349 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:56.004039 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:56.012612 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:56.013162 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:56.013957 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:56.014489 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:56.164100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b09d3c8f-3d10-4889-b1e4-9a07c19bf6ac tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:56.172345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b09d3c8f-3d10-4889-b1e4-9a07c19bf6ac tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.208261 Jul 12 07:13:56.172788 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 71/132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:55 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:56.187541 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:56.196285 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:56.197828 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:56.198926 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1a5b9710-251f-4cc4-9d7d-e42c85b481f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.199993 Jul 12 07:13:56.199488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 62/133] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:55 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:56.567102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-51f3af59-067c-4d89-9063-1970aff6a87b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:56.567672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-51f3af59-067c-4d89-9063-1970aff6a87b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:56.569321 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e0052f2a-2ce7-42fb-a066-76ba3b7f0097 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:56.570193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e0052f2a-2ce7-42fb-a066-76ba3b7f0097 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:56.577596 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-51f3af59-067c-4d89-9063-1970aff6a87b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:56.578236 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-51f3af59-067c-4d89-9063-1970aff6a87b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:56.579355 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-51f3af59-067c-4d89-9063-1970aff6a87b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:56.579674 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0052f2a-2ce7-42fb-a066-76ba3b7f0097 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:56.579830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-51f3af59-067c-4d89-9063-1970aff6a87b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:56.580164 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0052f2a-2ce7-42fb-a066-76ba3b7f0097 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:56.581083 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0052f2a-2ce7-42fb-a066-76ba3b7f0097 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:56.581541 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0052f2a-2ce7-42fb-a066-76ba3b7f0097 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:56.970059 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-51f3af59-067c-4d89-9063-1970aff6a87b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:56.973981 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e0052f2a-2ce7-42fb-a066-76ba3b7f0097 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:56.978841 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-51f3af59-067c-4d89-9063-1970aff6a87b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.417542 Jul 12 07:13:56.979480 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 72/134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:56 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:56.981766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e0052f2a-2ce7-42fb-a066-76ba3b7f0097 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.418079 Jul 12 07:13:56.989116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 63/135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:56 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:56.989306 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7bf3755e-c1e3-494e-a8ce-31d95f288f76 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:56.989306 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7bf3755e-c1e3-494e-a8ce-31d95f288f76 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:56.993460 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7bf3755e-c1e3-494e-a8ce-31d95f288f76 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:56.993911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7bf3755e-c1e3-494e-a8ce-31d95f288f76 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:56.994672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7bf3755e-c1e3-494e-a8ce-31d95f288f76 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:56.996053 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7bf3755e-c1e3-494e-a8ce-31d95f288f76 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:57.124643 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7bf3755e-c1e3-494e-a8ce-31d95f288f76 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:57.133459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7bf3755e-c1e3-494e-a8ce-31d95f288f76 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.152982 Jul 12 07:13:57.134033 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 73/136] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:56 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:57.189917 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-068bb558-0807-4795-ae80-98aa3d5d8cc3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:57.190515 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-068bb558-0807-4795-ae80-98aa3d5d8cc3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:57.197251 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-068bb558-0807-4795-ae80-98aa3d5d8cc3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:57.197690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-068bb558-0807-4795-ae80-98aa3d5d8cc3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:57.198441 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-068bb558-0807-4795-ae80-98aa3d5d8cc3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:57.198865 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-068bb558-0807-4795-ae80-98aa3d5d8cc3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:57.217239 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:57.217773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:57.224313 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:57.224755 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:57.225520 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:57.225976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:57.398548 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-068bb558-0807-4795-ae80-98aa3d5d8cc3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:57.401573 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:57.406599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-068bb558-0807-4795-ae80-98aa3d5d8cc3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.221152 Jul 12 07:13:57.407173 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 64/137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:57 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:57.411327 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:57.413750 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:57.415438 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6a779e64-d695-4d3e-99e2-30a5b4ce00f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.202059 Jul 12 07:13:57.416248 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 74/138] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:57 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:57.997924 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d96e341c-9596-4aeb-bd36-f9a797b57d67 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:57.998565 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d96e341c-9596-4aeb-bd36-f9a797b57d67 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:58.000526 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0b92743a-9efc-4eb6-b908-d922d82b0151 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:58.001161 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0b92743a-9efc-4eb6-b908-d922d82b0151 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:58.005768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d96e341c-9596-4aeb-bd36-f9a797b57d67 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.006353 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d96e341c-9596-4aeb-bd36-f9a797b57d67 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.007160 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d96e341c-9596-4aeb-bd36-f9a797b57d67 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.007578 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d96e341c-9596-4aeb-bd36-f9a797b57d67 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.009450 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0b92743a-9efc-4eb6-b908-d922d82b0151 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.009904 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0b92743a-9efc-4eb6-b908-d922d82b0151 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.010731 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0b92743a-9efc-4eb6-b908-d922d82b0151 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.011131 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0b92743a-9efc-4eb6-b908-d922d82b0151 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.016496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:13:58.204473 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d96e341c-9596-4aeb-bd36-f9a797b57d67 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:58.208013 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0b92743a-9efc-4eb6-b908-d922d82b0151 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:58.212582 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d96e341c-9596-4aeb-bd36-f9a797b57d67 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.220055 Jul 12 07:13:58.213156 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 65/139] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:57 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:58.215806 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0b92743a-9efc-4eb6-b908-d922d82b0151 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.220971 Jul 12 07:13:58.216668 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 75/140] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:57 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:58.217559 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6533d518-a664-47bd-8cb0-e5ce8c0ca131 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:58.218147 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6533d518-a664-47bd-8cb0-e5ce8c0ca131 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:58.224875 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6533d518-a664-47bd-8cb0-e5ce8c0ca131 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.225334 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6533d518-a664-47bd-8cb0-e5ce8c0ca131 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.226081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6533d518-a664-47bd-8cb0-e5ce8c0ca131 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.226542 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6533d518-a664-47bd-8cb0-e5ce8c0ca131 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.362599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6533d518-a664-47bd-8cb0-e5ce8c0ca131 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:58.370472 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6533d518-a664-47bd-8cb0-e5ce8c0ca131 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.156357 Jul 12 07:13:58.371045 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 66/141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:58 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:58.428380 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2abd06a5-911e-47e5-bf64-4c824fd907f4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:58.430433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2abd06a5-911e-47e5-bf64-4c824fd907f4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:58.436870 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:58.440480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:58.445119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2abd06a5-911e-47e5-bf64-4c824fd907f4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.446812 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2abd06a5-911e-47e5-bf64-4c824fd907f4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.448031 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2abd06a5-911e-47e5-bf64-4c824fd907f4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.448441 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.448880 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.449775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:58.450579 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2abd06a5-911e-47e5-bf64-4c824fd907f4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.451344 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:58.688096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2abd06a5-911e-47e5-bf64-4c824fd907f4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:58.696036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:58.696809 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2abd06a5-911e-47e5-bf64-4c824fd907f4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.272871 Jul 12 07:13:58.697455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 76/142] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:58 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:58.705578 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:58.707714 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:58.708856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2542ddcd-1e94-42ba-8d0a-ed05acd28e01 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.276631 Jul 12 07:13:58.713104 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 67/143] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:58 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:59.008821 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-2d9ac096-fc36-4f67-a015-0764260a603f req-76eaea98-9113-4370-b858-21e15d537f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7", "name": "network-vif-plugged", "status": "completed", "tag": "eab59db7-2167-4352-a4bb-fb23a341c8a3"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:13:59.019142 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2d9ac096-fc36-4f67-a015-0764260a603f req-76eaea98-9113-4370-b858-21e15d537f39 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.019594 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2d9ac096-fc36-4f67-a015-0764260a603f req-76eaea98-9113-4370-b858-21e15d537f39 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.033958 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-2d9ac096-fc36-4f67-a015-0764260a603f req-76eaea98-9113-4370-b858-21e15d537f39 service nova] Creating event network-vif-plugged:eab59db7-2167-4352-a4bb-fb23a341c8a3 for instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 on hv-cinder-82549 Jul 12 07:13:59.043293 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-2d9ac096-fc36-4f67-a015-0764260a603f req-76eaea98-9113-4370-b858-21e15d537f39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038448 Jul 12 07:13:59.043858 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 77/144] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:13:59.231730 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c8d55a0d-d5ee-4c2c-8753-81e920901d88 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:59.232593 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5911c031-4521-48b7-b9e3-692b7a5d4122 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:59.233151 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c8d55a0d-d5ee-4c2c-8753-81e920901d88 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:59.233454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5911c031-4521-48b7-b9e3-692b7a5d4122 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:59.241078 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8d55a0d-d5ee-4c2c-8753-81e920901d88 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.241975 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8d55a0d-d5ee-4c2c-8753-81e920901d88 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.243068 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8d55a0d-d5ee-4c2c-8753-81e920901d88 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.243830 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8d55a0d-d5ee-4c2c-8753-81e920901d88 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.245783 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5911c031-4521-48b7-b9e3-692b7a5d4122 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.247316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5911c031-4521-48b7-b9e3-692b7a5d4122 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.248185 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5911c031-4521-48b7-b9e3-692b7a5d4122 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.251332 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5911c031-4521-48b7-b9e3-692b7a5d4122 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.442618 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c8d55a0d-d5ee-4c2c-8753-81e920901d88 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:59.451943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c8d55a0d-d5ee-4c2c-8753-81e920901d88 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.224549 Jul 12 07:13:59.452541 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 68/145] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:59 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:59.458328 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e95577b3-a187-484c-aec7-c32c65b96a8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:59.459157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e95577b3-a187-484c-aec7-c32c65b96a8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:59.465865 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e95577b3-a187-484c-aec7-c32c65b96a8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.466238 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e95577b3-a187-484c-aec7-c32c65b96a8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.466996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e95577b3-a187-484c-aec7-c32c65b96a8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.467420 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e95577b3-a187-484c-aec7-c32c65b96a8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.473277 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5911c031-4521-48b7-b9e3-692b7a5d4122 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:59.480854 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5911c031-4521-48b7-b9e3-692b7a5d4122 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.252646 Jul 12 07:13:59.481679 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 78/146] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:59 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:59.597353 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e95577b3-a187-484c-aec7-c32c65b96a8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:59.605098 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e95577b3-a187-484c-aec7-c32c65b96a8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.151292 Jul 12 07:13:59.605665 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 69/147] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:59 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:13:59.713156 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ad6c4fc1-f36c-408b-8740-5c6eca73e50a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:59.713779 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ad6c4fc1-f36c-408b-8740-5c6eca73e50a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:59.720803 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad6c4fc1-f36c-408b-8740-5c6eca73e50a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.721468 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad6c4fc1-f36c-408b-8740-5c6eca73e50a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.722252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad6c4fc1-f36c-408b-8740-5c6eca73e50a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.722681 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad6c4fc1-f36c-408b-8740-5c6eca73e50a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.728021 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:13:59.728632 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:13:59.734882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.735484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.736403 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:13:59.737146 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:13:59.927282 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ad6c4fc1-f36c-408b-8740-5c6eca73e50a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:59.931046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:59.939240 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:59.940816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:13:59.941929 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-98aecb68-b535-4f6f-b598-e2eaedcb175a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.218340 Jul 12 07:13:59.942712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 70/148] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:13:59 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:13:59.944193 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ad6c4fc1-f36c-408b-8740-5c6eca73e50a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.234680 Jul 12 07:13:59.944771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 79/149] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:13:59 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:00.472996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78506c27-81ee-4a99-8828-136e7f57b0ac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:00.474095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78506c27-81ee-4a99-8828-136e7f57b0ac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:00.484649 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78506c27-81ee-4a99-8828-136e7f57b0ac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.485459 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78506c27-81ee-4a99-8828-136e7f57b0ac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:00.486610 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78506c27-81ee-4a99-8828-136e7f57b0ac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.487179 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78506c27-81ee-4a99-8828-136e7f57b0ac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:00.498300 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-703d5b09-1c07-4a55-9ed5-25176a6f8289 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:00.498902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-703d5b09-1c07-4a55-9ed5-25176a6f8289 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:00.505572 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-703d5b09-1c07-4a55-9ed5-25176a6f8289 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.505942 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-703d5b09-1c07-4a55-9ed5-25176a6f8289 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:00.506709 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-703d5b09-1c07-4a55-9ed5-25176a6f8289 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.507134 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-703d5b09-1c07-4a55-9ed5-25176a6f8289 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:00.691997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78506c27-81ee-4a99-8828-136e7f57b0ac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:00.699987 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78506c27-81ee-4a99-8828-136e7f57b0ac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.233441 Jul 12 07:14:00.700240 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-703d5b09-1c07-4a55-9ed5-25176a6f8289 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:00.700571 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 71/150] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:00 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:00.709893 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-703d5b09-1c07-4a55-9ed5-25176a6f8289 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.214282 Jul 12 07:14:00.709893 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 80/151] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:00 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:00.714092 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cfbad752-a75b-473e-8cbb-0326a21f60c6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:00.714917 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cfbad752-a75b-473e-8cbb-0326a21f60c6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:00.721595 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbad752-a75b-473e-8cbb-0326a21f60c6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.722025 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbad752-a75b-473e-8cbb-0326a21f60c6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:00.722765 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbad752-a75b-473e-8cbb-0326a21f60c6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.723183 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbad752-a75b-473e-8cbb-0326a21f60c6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:00.856848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cfbad752-a75b-473e-8cbb-0326a21f60c6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:00.861845 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:00.868935 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cfbad752-a75b-473e-8cbb-0326a21f60c6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.166423 Jul 12 07:14:00.869597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 72/152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:00 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:00.961587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-daa34ba4-b8bc-4984-a05b-a6b75eb41345 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:00.962374 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-daa34ba4-b8bc-4984-a05b-a6b75eb41345 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:00.968543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-daa34ba4-b8bc-4984-a05b-a6b75eb41345 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.968990 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-daa34ba4-b8bc-4984-a05b-a6b75eb41345 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:00.969783 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-daa34ba4-b8bc-4984-a05b-a6b75eb41345 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.970210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-daa34ba4-b8bc-4984-a05b-a6b75eb41345 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:00.971756 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:00.972371 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:00.979641 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.980232 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:00.981001 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:00.981449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:01.184263 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-daa34ba4-b8bc-4984-a05b-a6b75eb41345 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:01.187467 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:01.192854 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-daa34ba4-b8bc-4984-a05b-a6b75eb41345 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.235550 Jul 12 07:14:01.193619 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 81/153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:00 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:01.198046 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-fb0d07f0-5c95-412a-abea-2ac56d8c586c req-38ee50b1-e0ac-490b-8cd9-c6ca5dbcfa49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14bfba8-c99f-4905-8313-a0f83ba9a1e0", "name": "network-vif-plugged", "status": "completed", "tag": "7d978e15-5dca-4e8f-bd74-442e479f7431"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:01.203268 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:01.205095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:01.206511 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-fb0d07f0-5c95-412a-abea-2ac56d8c586c req-38ee50b1-e0ac-490b-8cd9-c6ca5dbcfa49 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:01.206628 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41619ec1-a83b-407b-b885-dbb310b0bd71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.249322 Jul 12 07:14:01.206938 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-fb0d07f0-5c95-412a-abea-2ac56d8c586c req-38ee50b1-e0ac-490b-8cd9-c6ca5dbcfa49 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:01.207329 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 73/154] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:14:00 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:14:01.224493 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-fb0d07f0-5c95-412a-abea-2ac56d8c586c req-38ee50b1-e0ac-490b-8cd9-c6ca5dbcfa49 service nova] Creating event network-vif-plugged:7d978e15-5dca-4e8f-bd74-442e479f7431 for instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 on hv-cinder-82549 Jul 12 07:14:01.229636 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-fb0d07f0-5c95-412a-abea-2ac56d8c586c req-38ee50b1-e0ac-490b-8cd9-c6ca5dbcfa49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035009 Jul 12 07:14:01.230224 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 82/155] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:14:01.721080 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-702ae20a-5cc5-43a9-9155-ac62ff0249e6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:01.722029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-702ae20a-5cc5-43a9-9155-ac62ff0249e6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:01.730925 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-40cca8a5-a1d4-4d2b-8f54-85a5e3528eac tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:01.732056 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-40cca8a5-a1d4-4d2b-8f54-85a5e3528eac tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:01.732467 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-702ae20a-5cc5-43a9-9155-ac62ff0249e6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:01.733255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-702ae20a-5cc5-43a9-9155-ac62ff0249e6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:01.734501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-702ae20a-5cc5-43a9-9155-ac62ff0249e6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:01.735209 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-702ae20a-5cc5-43a9-9155-ac62ff0249e6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:01.740183 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40cca8a5-a1d4-4d2b-8f54-85a5e3528eac tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:01.740631 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40cca8a5-a1d4-4d2b-8f54-85a5e3528eac tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:01.741422 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40cca8a5-a1d4-4d2b-8f54-85a5e3528eac tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:01.741855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40cca8a5-a1d4-4d2b-8f54-85a5e3528eac tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:01.928501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-702ae20a-5cc5-43a9-9155-ac62ff0249e6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:01.931359 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-40cca8a5-a1d4-4d2b-8f54-85a5e3528eac tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:01.937619 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-702ae20a-5cc5-43a9-9155-ac62ff0249e6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.223063 Jul 12 07:14:01.938238 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 74/156] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:01 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:01.939743 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-40cca8a5-a1d4-4d2b-8f54-85a5e3528eac tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.215791 Jul 12 07:14:01.940632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 83/157] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:01 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:01.943966 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-130a9afc-dee5-40f7-b2a0-b82f34347156 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:01.944558 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-130a9afc-dee5-40f7-b2a0-b82f34347156 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:01.951822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-130a9afc-dee5-40f7-b2a0-b82f34347156 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:01.952247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-130a9afc-dee5-40f7-b2a0-b82f34347156 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:01.953028 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-130a9afc-dee5-40f7-b2a0-b82f34347156 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:01.953493 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-130a9afc-dee5-40f7-b2a0-b82f34347156 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:02.097406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-130a9afc-dee5-40f7-b2a0-b82f34347156 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:02.104952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-130a9afc-dee5-40f7-b2a0-b82f34347156 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.165773 Jul 12 07:14:02.105575 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 75/158] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:01 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:02.208907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-01b0398f-cc8a-47e6-aa33-730003419488 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:02.209584 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-01b0398f-cc8a-47e6-aa33-730003419488 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:02.215649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-01b0398f-cc8a-47e6-aa33-730003419488 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:02.216052 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-01b0398f-cc8a-47e6-aa33-730003419488 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:02.216792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-01b0398f-cc8a-47e6-aa33-730003419488 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:02.218655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-01b0398f-cc8a-47e6-aa33-730003419488 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:02.224304 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:02.224978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:02.232092 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:02.232560 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:02.233326 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:02.233905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:02.429637 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:02.431303 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-01b0398f-cc8a-47e6-aa33-730003419488 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:02.438987 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:02.441182 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:02.442561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-723c181e-a7e6-464f-8742-f3c0760ecf8e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.222624 Jul 12 07:14:02.449027 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 76/159] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:14:02 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:14:02.449426 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-01b0398f-cc8a-47e6-aa33-730003419488 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.243122 Jul 12 07:14:02.449426 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 84/160] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:02 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:02.961491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2a82a378-680c-47d9-8991-9ee01a556635 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:02.962411 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-25bc4448-8224-48a5-bebd-c75d18f5ce5d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:02.962990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2a82a378-680c-47d9-8991-9ee01a556635 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:02.963225 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-25bc4448-8224-48a5-bebd-c75d18f5ce5d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:02.972253 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a82a378-680c-47d9-8991-9ee01a556635 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:02.972673 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25bc4448-8224-48a5-bebd-c75d18f5ce5d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:02.972807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a82a378-680c-47d9-8991-9ee01a556635 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:02.973154 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25bc4448-8224-48a5-bebd-c75d18f5ce5d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:02.973450 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a82a378-680c-47d9-8991-9ee01a556635 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:02.973871 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a82a378-680c-47d9-8991-9ee01a556635 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:02.974003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25bc4448-8224-48a5-bebd-c75d18f5ce5d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:02.974323 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25bc4448-8224-48a5-bebd-c75d18f5ce5d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:03.176326 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2a82a378-680c-47d9-8991-9ee01a556635 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:03.178328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-25bc4448-8224-48a5-bebd-c75d18f5ce5d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:03.184267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2a82a378-680c-47d9-8991-9ee01a556635 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.229415 Jul 12 07:14:03.184993 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 77/161] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:02 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:03.185932 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-25bc4448-8224-48a5-bebd-c75d18f5ce5d tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.231005 Jul 12 07:14:03.189354 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 85/162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:02 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:03.198642 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-808b8d06-be62-4c5b-8f67-24d19c9eb287 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:03.199250 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-808b8d06-be62-4c5b-8f67-24d19c9eb287 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:03.205323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-808b8d06-be62-4c5b-8f67-24d19c9eb287 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:03.205757 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-808b8d06-be62-4c5b-8f67-24d19c9eb287 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:03.206503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-808b8d06-be62-4c5b-8f67-24d19c9eb287 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:03.206923 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-808b8d06-be62-4c5b-8f67-24d19c9eb287 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:03.334607 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-808b8d06-be62-4c5b-8f67-24d19c9eb287 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:03.342145 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-808b8d06-be62-4c5b-8f67-24d19c9eb287 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.147906 Jul 12 07:14:03.342741 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 78/163] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:03 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:03.462685 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:03.463281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:03.465339 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-089778e3-9876-41a6-80f0-19720afb749a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:03.466055 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-089778e3-9876-41a6-80f0-19720afb749a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:03.470451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:03.471199 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:03.472916 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-089778e3-9876-41a6-80f0-19720afb749a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:03.473251 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:03.473518 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-089778e3-9876-41a6-80f0-19720afb749a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:03.474071 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:03.474545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-089778e3-9876-41a6-80f0-19720afb749a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:03.475030 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-089778e3-9876-41a6-80f0-19720afb749a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:03.686861 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-089778e3-9876-41a6-80f0-19720afb749a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:03.690535 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:03.697024 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-089778e3-9876-41a6-80f0-19720afb749a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.235378 Jul 12 07:14:03.706821 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 79/164] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:03 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:14:03.707451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:03.707451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:03.707451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6210ace5-3374-45a5-95a4-54c335e6a16e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.243876 Jul 12 07:14:03.707758 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 86/165] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:14:03 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:14:04.206513 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-102835ea-5d19-4bc2-959a-b1a71d3c6137 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:04.207745 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-29f58a76-774a-46f6-a7d5-399d7aad560f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:04.208175 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-102835ea-5d19-4bc2-959a-b1a71d3c6137 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:04.208328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-29f58a76-774a-46f6-a7d5-399d7aad560f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:04.214334 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-102835ea-5d19-4bc2-959a-b1a71d3c6137 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.214777 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-102835ea-5d19-4bc2-959a-b1a71d3c6137 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.214990 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-29f58a76-774a-46f6-a7d5-399d7aad560f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.215423 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-29f58a76-774a-46f6-a7d5-399d7aad560f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.215556 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-102835ea-5d19-4bc2-959a-b1a71d3c6137 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.215939 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-102835ea-5d19-4bc2-959a-b1a71d3c6137 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.216164 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-29f58a76-774a-46f6-a7d5-399d7aad560f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.216605 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-29f58a76-774a-46f6-a7d5-399d7aad560f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.409169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-29f58a76-774a-46f6-a7d5-399d7aad560f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:04.411598 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-102835ea-5d19-4bc2-959a-b1a71d3c6137 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:04.416870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-29f58a76-774a-46f6-a7d5-399d7aad560f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.214602 Jul 12 07:14:04.417809 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 87/166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:04 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:04.419464 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-102835ea-5d19-4bc2-959a-b1a71d3c6137 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.218542 Jul 12 07:14:04.420586 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 80/167] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:04 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:04.422886 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ec7d641d-f45e-48db-baba-2a74b1e7f61f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:04.423721 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ec7d641d-f45e-48db-baba-2a74b1e7f61f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:04.430347 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec7d641d-f45e-48db-baba-2a74b1e7f61f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.430805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec7d641d-f45e-48db-baba-2a74b1e7f61f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.431566 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec7d641d-f45e-48db-baba-2a74b1e7f61f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.431985 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec7d641d-f45e-48db-baba-2a74b1e7f61f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.568406 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ec7d641d-f45e-48db-baba-2a74b1e7f61f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:04.575970 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ec7d641d-f45e-48db-baba-2a74b1e7f61f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.157011 Jul 12 07:14:04.576546 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 88/168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:04 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:04.718747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae861cc0-df12-4e80-bbb5-efc1b617252e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:04.719681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ae861cc0-df12-4e80-bbb5-efc1b617252e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:04.725380 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:04.725626 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:04.730341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae861cc0-df12-4e80-bbb5-efc1b617252e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.730655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:04.731029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae861cc0-df12-4e80-bbb5-efc1b617252e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.732262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae861cc0-df12-4e80-bbb5-efc1b617252e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.732974 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae861cc0-df12-4e80-bbb5-efc1b617252e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.736976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.737443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.738191 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:04.738618 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:04.927788 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ae861cc0-df12-4e80-bbb5-efc1b617252e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:04.930772 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:04.935711 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ae861cc0-df12-4e80-bbb5-efc1b617252e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.223592 Jul 12 07:14:04.936319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 81/169] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:04 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:04.939480 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:04.940988 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:04.942114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1b3f7707-6cdb-475e-8546-058b1dd052d3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.224938 Jul 12 07:14:04.942668 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 89/170] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:14:04 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:14:05.434494 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30b25832-f852-40e1-bb51-11d1cc065b4b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:05.435080 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-30b25832-f852-40e1-bb51-11d1cc065b4b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:05.437576 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3eb0faa0-5fd9-4379-b0ad-9a9b468a38b1 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:05.438177 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3eb0faa0-5fd9-4379-b0ad-9a9b468a38b1 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:05.443137 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30b25832-f852-40e1-bb51-11d1cc065b4b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.443572 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30b25832-f852-40e1-bb51-11d1cc065b4b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:05.444277 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3eb0faa0-5fd9-4379-b0ad-9a9b468a38b1 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.444715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3eb0faa0-5fd9-4379-b0ad-9a9b468a38b1 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:05.444828 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30b25832-f852-40e1-bb51-11d1cc065b4b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.445192 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30b25832-f852-40e1-bb51-11d1cc065b4b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:05.445731 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3eb0faa0-5fd9-4379-b0ad-9a9b468a38b1 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.446477 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3eb0faa0-5fd9-4379-b0ad-9a9b468a38b1 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:05.778587 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-30b25832-f852-40e1-bb51-11d1cc065b4b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:05.781748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3eb0faa0-5fd9-4379-b0ad-9a9b468a38b1 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:05.786557 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-30b25832-f852-40e1-bb51-11d1cc065b4b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.356451 Jul 12 07:14:05.787331 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 82/171] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:05 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:05.790729 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3eb0faa0-5fd9-4379-b0ad-9a9b468a38b1 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.357721 Jul 12 07:14:05.791432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 90/172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:05 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:05.799238 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-86fb2592-adf6-4add-9bec-120c0807c9f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:05.799886 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-86fb2592-adf6-4add-9bec-120c0807c9f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:05.806333 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86fb2592-adf6-4add-9bec-120c0807c9f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.806790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86fb2592-adf6-4add-9bec-120c0807c9f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:05.807586 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86fb2592-adf6-4add-9bec-120c0807c9f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.808119 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86fb2592-adf6-4add-9bec-120c0807c9f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:05.948076 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-86fb2592-adf6-4add-9bec-120c0807c9f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:05.951683 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9dc7562b-67e3-4235-b5c4-8c4249a862be tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:05.952317 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9dc7562b-67e3-4235-b5c4-8c4249a862be tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:05.956502 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-86fb2592-adf6-4add-9bec-120c0807c9f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.168354 Jul 12 07:14:05.957365 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 83/173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:05 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:05.958638 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9dc7562b-67e3-4235-b5c4-8c4249a862be tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.959086 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9dc7562b-67e3-4235-b5c4-8c4249a862be tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:05.959846 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9dc7562b-67e3-4235-b5c4-8c4249a862be tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.960325 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9dc7562b-67e3-4235-b5c4-8c4249a862be tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:05.964019 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:05.964616 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:05.970824 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.971436 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:05.972178 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:05.972903 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:06.162654 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9dc7562b-67e3-4235-b5c4-8c4249a862be tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:06.187534 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9dc7562b-67e3-4235-b5c4-8c4249a862be tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.239428 Jul 12 07:14:06.189516 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:06.203295 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 91/174] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:05 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:14:06.214693 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:06.216554 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:06.217965 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2d692553-95b8-4dac-a22a-45750fc96a09 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.257963 Jul 12 07:14:06.230487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 84/175] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:14:05 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:14:06.805167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-99c7f9c3-e7d8-4725-bfd5-062d50dddbac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:06.805792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-99c7f9c3-e7d8-4725-bfd5-062d50dddbac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:06.808875 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4bed1f3b-d00a-4572-b601-90e229c67cfe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:06.810018 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4bed1f3b-d00a-4572-b601-90e229c67cfe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:06.813647 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99c7f9c3-e7d8-4725-bfd5-062d50dddbac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:06.814045 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99c7f9c3-e7d8-4725-bfd5-062d50dddbac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:06.815116 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99c7f9c3-e7d8-4725-bfd5-062d50dddbac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:06.815548 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99c7f9c3-e7d8-4725-bfd5-062d50dddbac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:06.818463 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bed1f3b-d00a-4572-b601-90e229c67cfe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:06.819309 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bed1f3b-d00a-4572-b601-90e229c67cfe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:06.820273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bed1f3b-d00a-4572-b601-90e229c67cfe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:06.822313 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bed1f3b-d00a-4572-b601-90e229c67cfe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:07.216834 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-99c7f9c3-e7d8-4725-bfd5-062d50dddbac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:07.224165 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4bed1f3b-d00a-4572-b601-90e229c67cfe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:07.224764 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-99c7f9c3-e7d8-4725-bfd5-062d50dddbac tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.425057 Jul 12 07:14:07.225736 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 92/176] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:06 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:07.230280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-342ab1b7-7604-424c-a588-496da21cfb37 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:07.230965 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-342ab1b7-7604-424c-a588-496da21cfb37 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:07.237557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-342ab1b7-7604-424c-a588-496da21cfb37 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:07.238272 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-342ab1b7-7604-424c-a588-496da21cfb37 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:07.239187 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-342ab1b7-7604-424c-a588-496da21cfb37 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:07.239686 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-342ab1b7-7604-424c-a588-496da21cfb37 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:07.240527 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4bed1f3b-d00a-4572-b601-90e229c67cfe tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.436317 Jul 12 07:14:07.250659 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 85/177] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:06 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:07.252479 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:07.264156 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-de775698-fac5-48bf-9004-eb1614c78ac5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:07.266923 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-de775698-fac5-48bf-9004-eb1614c78ac5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:07.274163 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de775698-fac5-48bf-9004-eb1614c78ac5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:07.274975 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de775698-fac5-48bf-9004-eb1614c78ac5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:07.276046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de775698-fac5-48bf-9004-eb1614c78ac5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:07.276931 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de775698-fac5-48bf-9004-eb1614c78ac5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:07.549940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-342ab1b7-7604-424c-a588-496da21cfb37 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:07.559947 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-342ab1b7-7604-424c-a588-496da21cfb37 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.332618 Jul 12 07:14:07.561585 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 93/178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:07 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:07.568280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:07.569188 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:07.578589 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-de775698-fac5-48bf-9004-eb1614c78ac5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:07.584257 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:07.584902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:07.586131 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:07.586944 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:07.587892 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-de775698-fac5-48bf-9004-eb1614c78ac5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.336174 Jul 12 07:14:07.589025 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 86/179] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:07 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:07.728732 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-cf791083-0412-4875-8cfc-6c4ffa598306 req-5e0575a3-90f8-4095-90ff-58fd058d41d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eae86e1-220e-41f6-9b8d-7b5a224f7a89", "name": "network-vif-plugged", "status": "completed", "tag": "7382a006-1c5b-424d-a60a-2f13d664f229"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:07.737572 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:07.746937 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-cf791083-0412-4875-8cfc-6c4ffa598306 req-5e0575a3-90f8-4095-90ff-58fd058d41d6 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:07.748117 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-cf791083-0412-4875-8cfc-6c4ffa598306 req-5e0575a3-90f8-4095-90ff-58fd058d41d6 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:07.749290 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:07.752090 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:07.753855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-23c6dfe8-951c-4c2b-b8d0-bd1e41278d56 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.190639 Jul 12 07:14:07.755041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 94/180] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:14:07 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:14:07.762626 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-cf791083-0412-4875-8cfc-6c4ffa598306 req-5e0575a3-90f8-4095-90ff-58fd058d41d6 service nova] Creating event network-vif-plugged:7382a006-1c5b-424d-a60a-2f13d664f229 for instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 on hv-cinder-82549 Jul 12 07:14:07.768022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-cf791083-0412-4875-8cfc-6c4ffa598306 req-5e0575a3-90f8-4095-90ff-58fd058d41d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044769 Jul 12 07:14:07.768875 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 87/181] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:14:08.242002 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-33a59260-fcdd-4be9-834f-9e1713e63f3d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:08.243269 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-33a59260-fcdd-4be9-834f-9e1713e63f3d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:08.249778 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-33a59260-fcdd-4be9-834f-9e1713e63f3d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.250216 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-33a59260-fcdd-4be9-834f-9e1713e63f3d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.251123 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-33a59260-fcdd-4be9-834f-9e1713e63f3d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.251547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-33a59260-fcdd-4be9-834f-9e1713e63f3d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.259216 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cde6a222-b463-487f-a8a5-3ad9ccdbc721 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:08.259916 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cde6a222-b463-487f-a8a5-3ad9ccdbc721 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:08.266561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cde6a222-b463-487f-a8a5-3ad9ccdbc721 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.267003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cde6a222-b463-487f-a8a5-3ad9ccdbc721 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.267767 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cde6a222-b463-487f-a8a5-3ad9ccdbc721 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.268191 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cde6a222-b463-487f-a8a5-3ad9ccdbc721 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.531837 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-33a59260-fcdd-4be9-834f-9e1713e63f3d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:08.540029 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-33a59260-fcdd-4be9-834f-9e1713e63f3d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.302060 Jul 12 07:14:08.541723 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 95/182] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:08 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:08.547275 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cde6a222-b463-487f-a8a5-3ad9ccdbc721 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:08.555448 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cde6a222-b463-487f-a8a5-3ad9ccdbc721 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.300931 Jul 12 07:14:08.556015 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 88/183] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:08 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:14:08.577655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d361e3de-76bc-42fc-9fb5-02c2e62962a7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:08.578254 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d361e3de-76bc-42fc-9fb5-02c2e62962a7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:08.584352 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d361e3de-76bc-42fc-9fb5-02c2e62962a7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.584789 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d361e3de-76bc-42fc-9fb5-02c2e62962a7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.585563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d361e3de-76bc-42fc-9fb5-02c2e62962a7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.585989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d361e3de-76bc-42fc-9fb5-02c2e62962a7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.608838 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-898c373f-27f3-46f5-b96a-81501ddf6f9d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:08.609944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-898c373f-27f3-46f5-b96a-81501ddf6f9d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:08.616491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-898c373f-27f3-46f5-b96a-81501ddf6f9d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.617167 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-898c373f-27f3-46f5-b96a-81501ddf6f9d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.618144 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-898c373f-27f3-46f5-b96a-81501ddf6f9d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.618568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-898c373f-27f3-46f5-b96a-81501ddf6f9d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.814329 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d361e3de-76bc-42fc-9fb5-02c2e62962a7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:08.817827 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-898c373f-27f3-46f5-b96a-81501ddf6f9d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:08.822528 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d361e3de-76bc-42fc-9fb5-02c2e62962a7 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.248681 Jul 12 07:14:08.823120 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 96/184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:08 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:08.826083 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-898c373f-27f3-46f5-b96a-81501ddf6f9d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.223251 Jul 12 07:14:08.826721 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 89/185] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:08 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:08.827762 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:08.828355 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:08.834602 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.835171 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.835926 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:08.836349 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:08.965444 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:08.974028 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:08.975572 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:08.976761 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5e66bea0-85ca-43e4-8614-aa7c96e5bb98 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.152651 Jul 12 07:14:08.977512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 97/186] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:14:08 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:14:09.558340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2d4fa035-ec86-4d4e-9262-3d94d48e44e8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:09.558901 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2d4fa035-ec86-4d4e-9262-3d94d48e44e8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:09.567311 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d4fa035-ec86-4d4e-9262-3d94d48e44e8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:09.567795 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d4fa035-ec86-4d4e-9262-3d94d48e44e8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:09.568594 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d4fa035-ec86-4d4e-9262-3d94d48e44e8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:09.569024 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d4fa035-ec86-4d4e-9262-3d94d48e44e8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:09.573855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1fbc587f-ef56-4309-ba4f-204cb873a19f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:09.573855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1fbc587f-ef56-4309-ba4f-204cb873a19f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:09.574341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:09.579478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1fbc587f-ef56-4309-ba4f-204cb873a19f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:09.580109 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1fbc587f-ef56-4309-ba4f-204cb873a19f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:09.581038 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1fbc587f-ef56-4309-ba4f-204cb873a19f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:09.581524 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1fbc587f-ef56-4309-ba4f-204cb873a19f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:09.769487 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1fbc587f-ef56-4309-ba4f-204cb873a19f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:09.773449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2d4fa035-ec86-4d4e-9262-3d94d48e44e8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:09.777133 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1fbc587f-ef56-4309-ba4f-204cb873a19f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.209086 Jul 12 07:14:09.777716 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 98/187] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:09 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:09.791444 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2d4fa035-ec86-4d4e-9262-3d94d48e44e8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.236966 Jul 12 07:14:09.795596 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-ed55c56b-75ed-4660-a44e-a735f5aa3588 req-3de6f859-a9ec-40d9-83e9-e18ae4a271c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a100f3-9f55-417b-b3c6-42ca96d65d76", "name": "network-vif-plugged", "status": "completed", "tag": "1ed4c67e-98fe-48ca-9c55-208d67325841"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:09.801580 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 90/188] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:09 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:09.804474 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ed55c56b-75ed-4660-a44e-a735f5aa3588 req-3de6f859-a9ec-40d9-83e9-e18ae4a271c3 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:09.805008 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ed55c56b-75ed-4660-a44e-a735f5aa3588 req-3de6f859-a9ec-40d9-83e9-e18ae4a271c3 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:09.818073 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-ed55c56b-75ed-4660-a44e-a735f5aa3588 req-3de6f859-a9ec-40d9-83e9-e18ae4a271c3 service nova] Creating event network-vif-plugged:1ed4c67e-98fe-48ca-9c55-208d67325841 for instance c8a100f3-9f55-417b-b3c6-42ca96d65d76 on hv-cinder-82549 Jul 12 07:14:09.824117 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-ed55c56b-75ed-4660-a44e-a735f5aa3588 req-3de6f859-a9ec-40d9-83e9-e18ae4a271c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033064 Jul 12 07:14:09.825455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 99/189] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:14:09.841970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c62bdf26-4714-4beb-a673-86208c068c4f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:09.842809 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c62bdf26-4714-4beb-a673-86208c068c4f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:09.843301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f6f72a12-219f-45ac-a287-7066aedeca2b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:09.843994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f6f72a12-219f-45ac-a287-7066aedeca2b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:09.850659 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c62bdf26-4714-4beb-a673-86208c068c4f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:09.851372 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c62bdf26-4714-4beb-a673-86208c068c4f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:09.852106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6f72a12-219f-45ac-a287-7066aedeca2b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:09.852546 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6f72a12-219f-45ac-a287-7066aedeca2b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:09.853186 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c62bdf26-4714-4beb-a673-86208c068c4f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:09.853317 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6f72a12-219f-45ac-a287-7066aedeca2b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:09.853731 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6f72a12-219f-45ac-a287-7066aedeca2b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:09.854134 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c62bdf26-4714-4beb-a673-86208c068c4f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:10.051952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f6f72a12-219f-45ac-a287-7066aedeca2b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:10.056129 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c62bdf26-4714-4beb-a673-86208c068c4f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:10.059730 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f6f72a12-219f-45ac-a287-7066aedeca2b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.220648 Jul 12 07:14:10.060387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 100/190] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:09 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:14:10.065191 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:10.065933 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:10.072004 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:10.072617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:10.072754 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c62bdf26-4714-4beb-a673-86208c068c4f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.237016 Jul 12 07:14:10.073347 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 91/191] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:09 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:10.073639 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:10.074107 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:10.208121 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:10.216462 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:10.217988 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:10.219082 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e31ba45d-e1b1-40c9-bf58-2926e3e5d721 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1408 microversion: 2.20 time: 0.157553 Jul 12 07:14:10.219639 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 101/192] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:14:10 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:14:10.796600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c1e9bc3b-034e-4d33-8181-69b4e2a9ac21 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:10.797411 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c1e9bc3b-034e-4d33-8181-69b4e2a9ac21 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:10.804522 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1e9bc3b-034e-4d33-8181-69b4e2a9ac21 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:10.805236 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1e9bc3b-034e-4d33-8181-69b4e2a9ac21 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:10.806487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1e9bc3b-034e-4d33-8181-69b4e2a9ac21 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:10.807258 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1e9bc3b-034e-4d33-8181-69b4e2a9ac21 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:10.811333 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b133a9b1-1dbf-4a96-93b9-78588026aff2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:10.812796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b133a9b1-1dbf-4a96-93b9-78588026aff2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:10.819122 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b133a9b1-1dbf-4a96-93b9-78588026aff2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:10.820013 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b133a9b1-1dbf-4a96-93b9-78588026aff2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:10.820990 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b133a9b1-1dbf-4a96-93b9-78588026aff2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:10.821815 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b133a9b1-1dbf-4a96-93b9-78588026aff2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:11.011544 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c1e9bc3b-034e-4d33-8181-69b4e2a9ac21 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:11.014711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b133a9b1-1dbf-4a96-93b9-78588026aff2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:11.023680 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b133a9b1-1dbf-4a96-93b9-78588026aff2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.218393 Jul 12 07:14:11.024492 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 102/193] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:10 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:11.026582 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c1e9bc3b-034e-4d33-8181-69b4e2a9ac21 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.235326 Jul 12 07:14:11.027216 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 92/194] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:10 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:11.077294 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-471ab484-eef3-40f5-bea4-0dfa2dd950fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:11.077902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-471ab484-eef3-40f5-bea4-0dfa2dd950fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:11.084840 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-471ab484-eef3-40f5-bea4-0dfa2dd950fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:11.085308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-471ab484-eef3-40f5-bea4-0dfa2dd950fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:11.086487 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-471ab484-eef3-40f5-bea4-0dfa2dd950fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:11.087085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-471ab484-eef3-40f5-bea4-0dfa2dd950fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:11.093163 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4c03e549-12ab-486c-b37c-aa16e8534f0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:11.093894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4c03e549-12ab-486c-b37c-aa16e8534f0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:11.102673 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c03e549-12ab-486c-b37c-aa16e8534f0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:11.103124 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c03e549-12ab-486c-b37c-aa16e8534f0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:11.103895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c03e549-12ab-486c-b37c-aa16e8534f0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:11.104329 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c03e549-12ab-486c-b37c-aa16e8534f0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:11.345633 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-471ab484-eef3-40f5-bea4-0dfa2dd950fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:11.350658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4c03e549-12ab-486c-b37c-aa16e8534f0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:11.358548 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-471ab484-eef3-40f5-bea4-0dfa2dd950fe tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.283871 Jul 12 07:14:11.358548 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 103/195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:11 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:11.363337 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:11.363876 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:11.370361 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:11.370808 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:11.371613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4c03e549-12ab-486c-b37c-aa16e8534f0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1364 microversion: 2.1 time: 0.283967 Jul 12 07:14:11.371763 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:11.372121 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:11.388289 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 93/196] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:11 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:14:11.511967 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:11.520061 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:11.521663 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:11.522810 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9add5342-00c8-4973-8be6-a5f7b64cb525 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1601 microversion: 2.20 time: 0.163759 Jul 12 07:14:11.523371 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 104/197] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:14:11 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:14:11.541232 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0d0863bd-b044-44e9-93c7-9245b2332fd5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:11.541736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0d0863bd-b044-44e9-93c7-9245b2332fd5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:11.548509 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d0863bd-b044-44e9-93c7-9245b2332fd5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:11.548978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d0863bd-b044-44e9-93c7-9245b2332fd5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:11.549759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d0863bd-b044-44e9-93c7-9245b2332fd5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:11.550251 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d0863bd-b044-44e9-93c7-9245b2332fd5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:11.676832 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0d0863bd-b044-44e9-93c7-9245b2332fd5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.139584 Jul 12 07:14:11.677491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 94/198] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 12 07:14:11 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:14:12.042587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f6e71979-60d1-4591-9a80-6e592784f5b1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:12.045189 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f6e71979-60d1-4591-9a80-6e592784f5b1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:12.045303 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ad3994ba-420b-4d7c-9b06-f4c98ce95a1a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:12.045900 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ad3994ba-420b-4d7c-9b06-f4c98ce95a1a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:12.052312 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6e71979-60d1-4591-9a80-6e592784f5b1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.053685 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6e71979-60d1-4591-9a80-6e592784f5b1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.053905 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6e71979-60d1-4591-9a80-6e592784f5b1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.054248 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad3994ba-420b-4d7c-9b06-f4c98ce95a1a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.054600 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f6e71979-60d1-4591-9a80-6e592784f5b1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.055029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad3994ba-420b-4d7c-9b06-f4c98ce95a1a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.056135 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad3994ba-420b-4d7c-9b06-f4c98ce95a1a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.056752 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad3994ba-420b-4d7c-9b06-f4c98ce95a1a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.467470 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ad3994ba-420b-4d7c-9b06-f4c98ce95a1a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:12.468164 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f6e71979-60d1-4591-9a80-6e592784f5b1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:12.480877 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ad3994ba-420b-4d7c-9b06-f4c98ce95a1a tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1314 microversion: 2.1 time: 0.441196 Jul 12 07:14:12.481346 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 95/199] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:12 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:12.486832 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f6e71979-60d1-4591-9a80-6e592784f5b1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.449944 Jul 12 07:14:12.487814 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 105/200] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:12 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:12.497358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7159da27-e09e-423e-b92d-f45e8f3da766 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:12.497358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7159da27-e09e-423e-b92d-f45e8f3da766 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:12.506003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7159da27-e09e-423e-b92d-f45e8f3da766 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.506297 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-59628372-d80e-435b-a6ea-e0da1fa92e3f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:12.507057 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7159da27-e09e-423e-b92d-f45e8f3da766 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.507195 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-59628372-d80e-435b-a6ea-e0da1fa92e3f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:12.507820 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7159da27-e09e-423e-b92d-f45e8f3da766 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.508242 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7159da27-e09e-423e-b92d-f45e8f3da766 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.515202 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59628372-d80e-435b-a6ea-e0da1fa92e3f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.515882 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59628372-d80e-435b-a6ea-e0da1fa92e3f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.516916 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59628372-d80e-435b-a6ea-e0da1fa92e3f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.517521 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-59628372-d80e-435b-a6ea-e0da1fa92e3f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.814153 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-59628372-d80e-435b-a6ea-e0da1fa92e3f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:12.815075 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7159da27-e09e-423e-b92d-f45e8f3da766 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:12.824914 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7159da27-e09e-423e-b92d-f45e8f3da766 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.340918 Jul 12 07:14:12.827183 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 96/201] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:12 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:12.833240 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-0508d2bb-5487-4bc1-9257-7191c86ca69e req-b12c522a-b105-41a7-847e-edf400a0c302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99231ef-ba9f-4294-87ab-e47992b4f001", "name": "network-vif-plugged", "status": "completed", "tag": "ad507e7e-5574-4340-9b10-2c7fbbf7fb11"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:12.841818 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-0508d2bb-5487-4bc1-9257-7191c86ca69e req-b12c522a-b105-41a7-847e-edf400a0c302 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.842461 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-0508d2bb-5487-4bc1-9257-7191c86ca69e req-b12c522a-b105-41a7-847e-edf400a0c302 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.854905 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-59628372-d80e-435b-a6ea-e0da1fa92e3f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1551 microversion: 2.1 time: 0.352751 Jul 12 07:14:12.855940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 106/202] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:12 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1551 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:12.858120 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-0508d2bb-5487-4bc1-9257-7191c86ca69e req-b12c522a-b105-41a7-847e-edf400a0c302 service nova] Creating event network-vif-plugged:ad507e7e-5574-4340-9b10-2c7fbbf7fb11 for instance e99231ef-ba9f-4294-87ab-e47992b4f001 on hv-cinder-82549 Jul 12 07:14:12.865218 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-0508d2bb-5487-4bc1-9257-7191c86ca69e req-b12c522a-b105-41a7-847e-edf400a0c302 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035554 Jul 12 07:14:12.865837 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 97/203] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:14:12.878137 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b1149d56-7b74-4d96-92e6-c56ba5e8861c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:12.878848 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b1149d56-7b74-4d96-92e6-c56ba5e8861c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:12.887524 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1149d56-7b74-4d96-92e6-c56ba5e8861c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.888458 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1149d56-7b74-4d96-92e6-c56ba5e8861c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:12.889845 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1149d56-7b74-4d96-92e6-c56ba5e8861c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:12.890607 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1149d56-7b74-4d96-92e6-c56ba5e8861c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:13.053321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b1149d56-7b74-4d96-92e6-c56ba5e8861c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180572 Jul 12 07:14:13.054777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 107/204] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 07:14:12 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:14:13.423278 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-ea405776-d0dd-4bce-8bbf-f1e784bd4db9 req-7e92487e-c970-4585-a7b1-5ace3395f714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1dba59c-e816-486d-9296-9fcd6e5a51ff", "tag": "e091627f-3767-4ff2-9414-c9935125f0fb"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:13.432652 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-ea405776-d0dd-4bce-8bbf-f1e784bd4db9 req-7e92487e-c970-4585-a7b1-5ace3395f714 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:13.433332 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-ea405776-d0dd-4bce-8bbf-f1e784bd4db9 req-7e92487e-c970-4585-a7b1-5ace3395f714 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:13.447061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-ea405776-d0dd-4bce-8bbf-f1e784bd4db9 req-7e92487e-c970-4585-a7b1-5ace3395f714 service nova] Creating event network-changed:e091627f-3767-4ff2-9414-c9935125f0fb for instance e1dba59c-e816-486d-9296-9fcd6e5a51ff on hv-cinder-82549 Jul 12 07:14:13.452179 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-ea405776-d0dd-4bce-8bbf-f1e784bd4db9 req-7e92487e-c970-4585-a7b1-5ace3395f714 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036926 Jul 12 07:14:13.453112 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 98/205] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:14:13.501811 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-37a3acd2-fcaa-4093-a556-0ea99189af23 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:13.502905 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-37a3acd2-fcaa-4093-a556-0ea99189af23 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:13.510445 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0728acf1-aad0-452a-bc01-53addae60556 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:13.511142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0728acf1-aad0-452a-bc01-53addae60556 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:13.511824 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37a3acd2-fcaa-4093-a556-0ea99189af23 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:13.512482 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37a3acd2-fcaa-4093-a556-0ea99189af23 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:13.514123 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37a3acd2-fcaa-4093-a556-0ea99189af23 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:13.515212 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-37a3acd2-fcaa-4093-a556-0ea99189af23 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:13.518561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0728acf1-aad0-452a-bc01-53addae60556 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:13.519045 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0728acf1-aad0-452a-bc01-53addae60556 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:13.519798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0728acf1-aad0-452a-bc01-53addae60556 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:13.520399 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0728acf1-aad0-452a-bc01-53addae60556 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:14.229081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0728acf1-aad0-452a-bc01-53addae60556 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:14.237793 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0728acf1-aad0-452a-bc01-53addae60556 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.736339 Jul 12 07:14:14.238034 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-37a3acd2-fcaa-4093-a556-0ea99189af23 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:14.239132 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 99/206] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:13 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:14.245888 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-75eaa3ad-5334-4a1c-b160-c4b0241f98ae tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:14.246695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-75eaa3ad-5334-4a1c-b160-c4b0241f98ae tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:14.254440 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75eaa3ad-5334-4a1c-b160-c4b0241f98ae tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:14.255079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75eaa3ad-5334-4a1c-b160-c4b0241f98ae tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:14.256005 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75eaa3ad-5334-4a1c-b160-c4b0241f98ae tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:14.256583 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75eaa3ad-5334-4a1c-b160-c4b0241f98ae tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:14.260172 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-37a3acd2-fcaa-4093-a556-0ea99189af23 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1502 microversion: 2.1 time: 0.765705 Jul 12 07:14:14.260833 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 108/207] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:13 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1502 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:14.619188 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-75eaa3ad-5334-4a1c-b160-c4b0241f98ae tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:14.629740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-75eaa3ad-5334-4a1c-b160-c4b0241f98ae tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.389089 Jul 12 07:14:14.631702 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 100/208] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:14 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:15.037455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-32d0eb14-3b67-42b6-967b-dbee41b795c0 req-70754432-3c4c-470a-8aa5-4c32dc25c3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7", "tag": "eab59db7-2167-4352-a4bb-fb23a341c8a3"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:15.046108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-32d0eb14-3b67-42b6-967b-dbee41b795c0 req-70754432-3c4c-470a-8aa5-4c32dc25c3f9 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:15.046548 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-32d0eb14-3b67-42b6-967b-dbee41b795c0 req-70754432-3c4c-470a-8aa5-4c32dc25c3f9 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:15.057640 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-32d0eb14-3b67-42b6-967b-dbee41b795c0 req-70754432-3c4c-470a-8aa5-4c32dc25c3f9 service nova] Creating event network-changed:eab59db7-2167-4352-a4bb-fb23a341c8a3 for instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 on hv-cinder-82549 Jul 12 07:14:15.062853 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-32d0eb14-3b67-42b6-967b-dbee41b795c0 req-70754432-3c4c-470a-8aa5-4c32dc25c3f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029066 Jul 12 07:14:15.063449 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 109/209] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:14:15.255842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3227870c-c70d-4e4f-a18e-6791658845a9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:15.256647 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3227870c-c70d-4e4f-a18e-6791658845a9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:15.263158 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3227870c-c70d-4e4f-a18e-6791658845a9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:15.263817 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3227870c-c70d-4e4f-a18e-6791658845a9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:15.264578 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3227870c-c70d-4e4f-a18e-6791658845a9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:15.264994 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3227870c-c70d-4e4f-a18e-6791658845a9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:15.402300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3227870c-c70d-4e4f-a18e-6791658845a9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:15.410912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3227870c-c70d-4e4f-a18e-6791658845a9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.158994 Jul 12 07:14:15.411481 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 101/210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:15 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:15.649418 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ea47a853-38e6-4ed7-80f0-4e18c9a64d9b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:15.650025 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ea47a853-38e6-4ed7-80f0-4e18c9a64d9b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:15.657083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea47a853-38e6-4ed7-80f0-4e18c9a64d9b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:15.657562 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea47a853-38e6-4ed7-80f0-4e18c9a64d9b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:15.658322 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea47a853-38e6-4ed7-80f0-4e18c9a64d9b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:15.658739 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea47a853-38e6-4ed7-80f0-4e18c9a64d9b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:15.798564 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ea47a853-38e6-4ed7-80f0-4e18c9a64d9b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:15.806501 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ea47a853-38e6-4ed7-80f0-4e18c9a64d9b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.163176 Jul 12 07:14:15.807089 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 110/211] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:15 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:16.428510 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b773d64a-b48d-4925-95fc-a49d697ab276 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:16.429107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b773d64a-b48d-4925-95fc-a49d697ab276 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:16.435986 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b773d64a-b48d-4925-95fc-a49d697ab276 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:16.436359 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b773d64a-b48d-4925-95fc-a49d697ab276 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:16.437138 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b773d64a-b48d-4925-95fc-a49d697ab276 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:16.437713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b773d64a-b48d-4925-95fc-a49d697ab276 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:16.572288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b773d64a-b48d-4925-95fc-a49d697ab276 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:16.583522 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b773d64a-b48d-4925-95fc-a49d697ab276 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.158902 Jul 12 07:14:16.584313 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 102/212] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:16 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:16.788797 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-68193d6e-e7be-44e6-ac05-12f86911b435 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8d3b52b-8f8e-4166-84e3-51c865999949"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:16.790012 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-68193d6e-e7be-44e6-ac05-12f86911b435 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:16.797095 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-68193d6e-e7be-44e6-ac05-12f86911b435 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:16.797573 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-68193d6e-e7be-44e6-ac05-12f86911b435 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:16.798326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-68193d6e-e7be-44e6-ac05-12f86911b435 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:16.798754 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-68193d6e-e7be-44e6-ac05-12f86911b435 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:16.816330 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:16.824263 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78b0f127-f872-4be6-9850-93f477153c01 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:16.825211 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78b0f127-f872-4be6-9850-93f477153c01 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:16.831537 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b0f127-f872-4be6-9850-93f477153c01 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:16.832522 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b0f127-f872-4be6-9850-93f477153c01 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:16.833681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b0f127-f872-4be6-9850-93f477153c01 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:16.834312 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b0f127-f872-4be6-9850-93f477153c01 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:17.003739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78b0f127-f872-4be6-9850-93f477153c01 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:17.011376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78b0f127-f872-4be6-9850-93f477153c01 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.191142 Jul 12 07:14:17.012202 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 103/213] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:16 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:17.267185 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-68193d6e-e7be-44e6-ac05-12f86911b435 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "POST /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482368 Jul 12 07:14:17.267915 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 111/214] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:14:16 2022] POST /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:14:17.601673 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ff9cc5a7-89b7-450d-acb8-f2754dcc2533 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:17.602432 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ff9cc5a7-89b7-450d-acb8-f2754dcc2533 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:17.610520 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff9cc5a7-89b7-450d-acb8-f2754dcc2533 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:17.611203 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff9cc5a7-89b7-450d-acb8-f2754dcc2533 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:17.612308 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff9cc5a7-89b7-450d-acb8-f2754dcc2533 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:17.612951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff9cc5a7-89b7-450d-acb8-f2754dcc2533 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:17.780689 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ff9cc5a7-89b7-450d-acb8-f2754dcc2533 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:17.793583 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ff9cc5a7-89b7-450d-acb8-f2754dcc2533 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.196049 Jul 12 07:14:17.803778 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 104/215] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:17 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:18.029773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f4d916bb-2209-4c27-94cc-ba850b795813 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:18.030453 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f4d916bb-2209-4c27-94cc-ba850b795813 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:18.037140 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4d916bb-2209-4c27-94cc-ba850b795813 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:18.038064 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4d916bb-2209-4c27-94cc-ba850b795813 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:18.038911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4d916bb-2209-4c27-94cc-ba850b795813 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:18.039403 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4d916bb-2209-4c27-94cc-ba850b795813 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:18.175050 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f4d916bb-2209-4c27-94cc-ba850b795813 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:18.183294 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f4d916bb-2209-4c27-94cc-ba850b795813 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.158643 Jul 12 07:14:18.183856 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 112/216] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:18 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:18.811664 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-afdeaa06-bdec-4632-9f0e-e04b70bc8ed1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:18.812269 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-afdeaa06-bdec-4632-9f0e-e04b70bc8ed1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:18.818644 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afdeaa06-bdec-4632-9f0e-e04b70bc8ed1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:18.819078 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afdeaa06-bdec-4632-9f0e-e04b70bc8ed1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:18.819823 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afdeaa06-bdec-4632-9f0e-e04b70bc8ed1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:18.820244 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afdeaa06-bdec-4632-9f0e-e04b70bc8ed1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:19.012480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afdeaa06-bdec-4632-9f0e-e04b70bc8ed1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:19.021029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-afdeaa06-bdec-4632-9f0e-e04b70bc8ed1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.213437 Jul 12 07:14:19.021756 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 105/217] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:18 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:19.199972 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bec5fae1-2bd8-4e23-8fe7-55bb78d8f079 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:19.200684 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bec5fae1-2bd8-4e23-8fe7-55bb78d8f079 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:19.207261 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bec5fae1-2bd8-4e23-8fe7-55bb78d8f079 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:19.207792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bec5fae1-2bd8-4e23-8fe7-55bb78d8f079 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:19.208606 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bec5fae1-2bd8-4e23-8fe7-55bb78d8f079 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:19.209118 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bec5fae1-2bd8-4e23-8fe7-55bb78d8f079 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:19.342468 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bec5fae1-2bd8-4e23-8fe7-55bb78d8f079 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:19.350622 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bec5fae1-2bd8-4e23-8fe7-55bb78d8f079 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.154476 Jul 12 07:14:19.351201 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 113/218] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:19 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:20.037969 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-94c64373-b462-495b-b4e5-0520a2b835ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:20.038585 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-94c64373-b462-495b-b4e5-0520a2b835ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:20.040708 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:20.046804 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94c64373-b462-495b-b4e5-0520a2b835ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:20.047267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94c64373-b462-495b-b4e5-0520a2b835ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:20.048033 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94c64373-b462-495b-b4e5-0520a2b835ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:20.048461 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94c64373-b462-495b-b4e5-0520a2b835ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:20.192497 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-94c64373-b462-495b-b4e5-0520a2b835ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:20.200101 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-94c64373-b462-495b-b4e5-0520a2b835ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.166286 Jul 12 07:14:20.201440 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 106/219] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:20 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:20.367592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-763c1d4e-17fa-4f6d-8bff-0da22b3b05fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:20.369024 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-763c1d4e-17fa-4f6d-8bff-0da22b3b05fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:20.376698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-763c1d4e-17fa-4f6d-8bff-0da22b3b05fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:20.376698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-763c1d4e-17fa-4f6d-8bff-0da22b3b05fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:20.376698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-763c1d4e-17fa-4f6d-8bff-0da22b3b05fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:20.376698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-763c1d4e-17fa-4f6d-8bff-0da22b3b05fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:20.534627 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-763c1d4e-17fa-4f6d-8bff-0da22b3b05fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:20.546773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-763c1d4e-17fa-4f6d-8bff-0da22b3b05fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.183240 Jul 12 07:14:20.547581 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 114/220] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:20 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:21.217640 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f9e33eca-9bec-4321-8c2b-531fd6da1747 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:21.218338 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f9e33eca-9bec-4321-8c2b-531fd6da1747 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:21.224696 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9e33eca-9bec-4321-8c2b-531fd6da1747 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:21.225452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9e33eca-9bec-4321-8c2b-531fd6da1747 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:21.226342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9e33eca-9bec-4321-8c2b-531fd6da1747 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:21.226832 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9e33eca-9bec-4321-8c2b-531fd6da1747 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:21.406802 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f9e33eca-9bec-4321-8c2b-531fd6da1747 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:21.415975 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f9e33eca-9bec-4321-8c2b-531fd6da1747 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.202411 Jul 12 07:14:21.416566 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 107/221] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:21 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:21.567352 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-39485a83-3135-44fe-b2c0-0a245629050a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:21.568011 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-39485a83-3135-44fe-b2c0-0a245629050a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:21.575066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39485a83-3135-44fe-b2c0-0a245629050a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:21.575504 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39485a83-3135-44fe-b2c0-0a245629050a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:21.576255 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39485a83-3135-44fe-b2c0-0a245629050a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:21.576682 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39485a83-3135-44fe-b2c0-0a245629050a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:21.738553 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-39485a83-3135-44fe-b2c0-0a245629050a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:21.746061 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-39485a83-3135-44fe-b2c0-0a245629050a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1322 microversion: 2.1 time: 0.183206 Jul 12 07:14:21.746637 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 115/222] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:21 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:22.434386 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fb03de16-688c-48da-8b13-e5adeba2b227 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:22.435073 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fb03de16-688c-48da-8b13-e5adeba2b227 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:22.442179 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fb03de16-688c-48da-8b13-e5adeba2b227 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:22.442654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fb03de16-688c-48da-8b13-e5adeba2b227 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:22.443430 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fb03de16-688c-48da-8b13-e5adeba2b227 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:22.443944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fb03de16-688c-48da-8b13-e5adeba2b227 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:22.463253 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:22.763531 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-82d08d2a-5ab1-4687-bba3-d03c573464dd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:22.764263 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-82d08d2a-5ab1-4687-bba3-d03c573464dd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:22.772055 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-82d08d2a-5ab1-4687-bba3-d03c573464dd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:22.772581 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-82d08d2a-5ab1-4687-bba3-d03c573464dd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:22.773576 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-82d08d2a-5ab1-4687-bba3-d03c573464dd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:22.774176 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-82d08d2a-5ab1-4687-bba3-d03c573464dd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:22.796819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fb03de16-688c-48da-8b13-e5adeba2b227 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:22.807473 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fb03de16-688c-48da-8b13-e5adeba2b227 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.377348 Jul 12 07:14:22.808635 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 108/223] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:22 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:14:22.915642 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-82d08d2a-5ab1-4687-bba3-d03c573464dd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:22.923425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-82d08d2a-5ab1-4687-bba3-d03c573464dd tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1516 microversion: 2.1 time: 0.164278 Jul 12 07:14:22.924000 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 116/224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:22 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:22.941301 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2c7178a3-a71e-46d3-ad53-97e015f3b491 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:22.942248 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2c7178a3-a71e-46d3-ad53-97e015f3b491 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:22.949211 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c7178a3-a71e-46d3-ad53-97e015f3b491 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:22.949660 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c7178a3-a71e-46d3-ad53-97e015f3b491 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:22.950423 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c7178a3-a71e-46d3-ad53-97e015f3b491 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:22.950854 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c7178a3-a71e-46d3-ad53-97e015f3b491 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:22.975643 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-2c7178a3-a71e-46d3-ad53-97e015f3b491 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lazy-loading 'flavor' on Instance uuid c8a100f3-9f55-417b-b3c6-42ca96d65d76 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:14:23.106935 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2c7178a3-a71e-46d3-ad53-97e015f3b491 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76/action" status: 200 len: 32 microversion: 2.1 time: 0.169353 Jul 12 07:14:23.107664 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 109/225] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:14:22 2022] POST /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:14:23.117227 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8b80031c-ac75-4b03-8604-114a4d792a11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:23.118200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8b80031c-ac75-4b03-8604-114a4d792a11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:23.125103 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b80031c-ac75-4b03-8604-114a4d792a11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:23.125699 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b80031c-ac75-4b03-8604-114a4d792a11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:23.126598 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b80031c-ac75-4b03-8604-114a4d792a11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:23.127165 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b80031c-ac75-4b03-8604-114a4d792a11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:23.290780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8b80031c-ac75-4b03-8604-114a4d792a11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:23.300373 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8b80031c-ac75-4b03-8604-114a4d792a11 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.187312 Jul 12 07:14:23.301368 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 117/226] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:23 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:23.825782 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f5f73921-6091-46d5-9570-32f2ca955303 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:23.827174 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f5f73921-6091-46d5-9570-32f2ca955303 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:23.836049 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5f73921-6091-46d5-9570-32f2ca955303 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:23.836485 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5f73921-6091-46d5-9570-32f2ca955303 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:23.837280 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5f73921-6091-46d5-9570-32f2ca955303 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:23.837707 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5f73921-6091-46d5-9570-32f2ca955303 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:23.982694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f5f73921-6091-46d5-9570-32f2ca955303 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:23.991939 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f5f73921-6091-46d5-9570-32f2ca955303 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.170883 Jul 12 07:14:24.002431 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 110/227] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:23 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:24.317975 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-50a85594-21f1-4502-b3bb-077ed844bde0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:24.319249 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-50a85594-21f1-4502-b3bb-077ed844bde0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:24.326370 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50a85594-21f1-4502-b3bb-077ed844bde0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:24.326806 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50a85594-21f1-4502-b3bb-077ed844bde0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:24.327745 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50a85594-21f1-4502-b3bb-077ed844bde0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:24.328321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50a85594-21f1-4502-b3bb-077ed844bde0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:24.538207 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-50a85594-21f1-4502-b3bb-077ed844bde0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:24.547754 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-50a85594-21f1-4502-b3bb-077ed844bde0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.233642 Jul 12 07:14:24.548423 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 118/228] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:24 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:25.010862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ec3fa964-1273-48a5-a342-4c292f04e472 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:25.011462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ec3fa964-1273-48a5-a342-4c292f04e472 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:25.018594 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec3fa964-1273-48a5-a342-4c292f04e472 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:25.019370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec3fa964-1273-48a5-a342-4c292f04e472 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:25.020195 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec3fa964-1273-48a5-a342-4c292f04e472 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:25.020545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec3fa964-1273-48a5-a342-4c292f04e472 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:25.310972 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ec3fa964-1273-48a5-a342-4c292f04e472 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:25.321190 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ec3fa964-1273-48a5-a342-4c292f04e472 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1366 microversion: 2.1 time: 0.315333 Jul 12 07:14:25.322476 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 111/229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:25 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:14:25.565516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cd802e76-4333-4789-bf9b-81c0887600ff tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:25.566120 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cd802e76-4333-4789-bf9b-81c0887600ff tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:25.574571 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd802e76-4333-4789-bf9b-81c0887600ff tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:25.575082 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd802e76-4333-4789-bf9b-81c0887600ff tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:25.576033 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd802e76-4333-4789-bf9b-81c0887600ff tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:25.576459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd802e76-4333-4789-bf9b-81c0887600ff tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:25.743596 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cd802e76-4333-4789-bf9b-81c0887600ff tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:25.757155 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cd802e76-4333-4789-bf9b-81c0887600ff tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.195551 Jul 12 07:14:25.762533 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 119/230] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:25 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:26.340102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3a7368ab-f7b5-4cf3-9857-a6241a2e1f76 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:26.340720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3a7368ab-f7b5-4cf3-9857-a6241a2e1f76 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:26.347573 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a7368ab-f7b5-4cf3-9857-a6241a2e1f76 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:26.348009 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a7368ab-f7b5-4cf3-9857-a6241a2e1f76 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:26.348875 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a7368ab-f7b5-4cf3-9857-a6241a2e1f76 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:26.349452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a7368ab-f7b5-4cf3-9857-a6241a2e1f76 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:26.575083 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3a7368ab-f7b5-4cf3-9857-a6241a2e1f76 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:26.583654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3a7368ab-f7b5-4cf3-9857-a6241a2e1f76 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1556 microversion: 2.1 time: 0.248766 Jul 12 07:14:26.601365 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0cf2bf49-e04a-4907-93bd-ed58fcbc443a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:26.601919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0cf2bf49-e04a-4907-93bd-ed58fcbc443a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:26.608523 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0cf2bf49-e04a-4907-93bd-ed58fcbc443a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:26.608954 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0cf2bf49-e04a-4907-93bd-ed58fcbc443a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:26.609738 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0cf2bf49-e04a-4907-93bd-ed58fcbc443a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:26.610159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0cf2bf49-e04a-4907-93bd-ed58fcbc443a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:26.612340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 112/231] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:26 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1556 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:26.695431 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0cf2bf49-e04a-4907-93bd-ed58fcbc443a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098529 Jul 12 07:14:26.696022 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 120/232] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 07:14:26 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:14:26.779998 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dcb66e9e-2a4d-4ac2-97fd-829839db465a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:26.780788 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dcb66e9e-2a4d-4ac2-97fd-829839db465a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:26.788761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcb66e9e-2a4d-4ac2-97fd-829839db465a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:26.789308 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcb66e9e-2a4d-4ac2-97fd-829839db465a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:26.790188 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcb66e9e-2a4d-4ac2-97fd-829839db465a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:26.790680 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcb66e9e-2a4d-4ac2-97fd-829839db465a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:27.037430 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dcb66e9e-2a4d-4ac2-97fd-829839db465a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:27.046334 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dcb66e9e-2a4d-4ac2-97fd-829839db465a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.270987 Jul 12 07:14:27.047067 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 113/233] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:26 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:28.066613 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fde4efd8-4132-462d-b041-bfc9a1b8615e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:28.067141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-b8f12d55-12c2-4ad1-b701-2b64c703d5f4 req-e242bc20-e026-41e4-be9f-376ffe2fb750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99231ef-ba9f-4294-87ab-e47992b4f001", "tag": "ad507e7e-5574-4340-9b10-2c7fbbf7fb11"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:28.067652 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fde4efd8-4132-462d-b041-bfc9a1b8615e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:28.075258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fde4efd8-4132-462d-b041-bfc9a1b8615e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:28.075690 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fde4efd8-4132-462d-b041-bfc9a1b8615e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:28.076654 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fde4efd8-4132-462d-b041-bfc9a1b8615e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:28.077104 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fde4efd8-4132-462d-b041-bfc9a1b8615e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:28.085310 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b8f12d55-12c2-4ad1-b701-2b64c703d5f4 req-e242bc20-e026-41e4-be9f-376ffe2fb750 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:28.086033 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b8f12d55-12c2-4ad1-b701-2b64c703d5f4 req-e242bc20-e026-41e4-be9f-376ffe2fb750 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:28.098113 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-b8f12d55-12c2-4ad1-b701-2b64c703d5f4 req-e242bc20-e026-41e4-be9f-376ffe2fb750 service nova] Creating event network-changed:ad507e7e-5574-4340-9b10-2c7fbbf7fb11 for instance e99231ef-ba9f-4294-87ab-e47992b4f001 on hv-cinder-82549 Jul 12 07:14:28.107293 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-b8f12d55-12c2-4ad1-b701-2b64c703d5f4 req-e242bc20-e026-41e4-be9f-376ffe2fb750 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044181 Jul 12 07:14:28.109737 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 114/234] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:14:28.224857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fde4efd8-4132-462d-b041-bfc9a1b8615e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:28.234751 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fde4efd8-4132-462d-b041-bfc9a1b8615e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.173860 Jul 12 07:14:28.235471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 121/235] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:28 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:29.253016 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-04a3f17b-53bf-421f-925c-5d907c62d4f9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:29.253738 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-04a3f17b-53bf-421f-925c-5d907c62d4f9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:29.260632 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04a3f17b-53bf-421f-925c-5d907c62d4f9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:29.261090 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04a3f17b-53bf-421f-925c-5d907c62d4f9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:29.261856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04a3f17b-53bf-421f-925c-5d907c62d4f9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:29.262286 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04a3f17b-53bf-421f-925c-5d907c62d4f9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:29.405397 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-04a3f17b-53bf-421f-925c-5d907c62d4f9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:29.416459 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-04a3f17b-53bf-421f-925c-5d907c62d4f9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.167934 Jul 12 07:14:29.417040 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 115/236] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:29 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:30.434380 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e1a36fd6-b57e-4718-988e-6ce77c2b23b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:30.434940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e1a36fd6-b57e-4718-988e-6ce77c2b23b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:30.441960 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e1a36fd6-b57e-4718-988e-6ce77c2b23b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:30.442394 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e1a36fd6-b57e-4718-988e-6ce77c2b23b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:30.443409 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e1a36fd6-b57e-4718-988e-6ce77c2b23b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:30.443663 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e1a36fd6-b57e-4718-988e-6ce77c2b23b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:30.581331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e1a36fd6-b57e-4718-988e-6ce77c2b23b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:30.589287 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e1a36fd6-b57e-4718-988e-6ce77c2b23b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.158907 Jul 12 07:14:30.589867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 122/237] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:30 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:31.608742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-20a5b7e4-912b-458f-999f-b2d1c3125683 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:31.609282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-20a5b7e4-912b-458f-999f-b2d1c3125683 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:31.617438 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20a5b7e4-912b-458f-999f-b2d1c3125683 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:31.617878 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20a5b7e4-912b-458f-999f-b2d1c3125683 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:31.618625 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20a5b7e4-912b-458f-999f-b2d1c3125683 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:31.619047 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20a5b7e4-912b-458f-999f-b2d1c3125683 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:31.751204 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-20a5b7e4-912b-458f-999f-b2d1c3125683 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:31.761700 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-20a5b7e4-912b-458f-999f-b2d1c3125683 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.158911 Jul 12 07:14:31.762297 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 116/238] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:31 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:32.778138 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8a0dd653-1168-4e59-81c8-2a31d8339f81 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:32.778769 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8a0dd653-1168-4e59-81c8-2a31d8339f81 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:32.785972 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a0dd653-1168-4e59-81c8-2a31d8339f81 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:32.786414 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a0dd653-1168-4e59-81c8-2a31d8339f81 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:32.787152 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a0dd653-1168-4e59-81c8-2a31d8339f81 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:32.788149 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a0dd653-1168-4e59-81c8-2a31d8339f81 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:32.933440 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8a0dd653-1168-4e59-81c8-2a31d8339f81 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:32.943026 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8a0dd653-1168-4e59-81c8-2a31d8339f81 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.168755 Jul 12 07:14:32.943872 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 123/239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:32 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:33.959922 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-21d3816e-e1ab-4276-9f46-e107f8eaf497 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:33.961597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-21d3816e-e1ab-4276-9f46-e107f8eaf497 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:33.967901 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-21d3816e-e1ab-4276-9f46-e107f8eaf497 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:33.968354 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-21d3816e-e1ab-4276-9f46-e107f8eaf497 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:33.969119 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-21d3816e-e1ab-4276-9f46-e107f8eaf497 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:33.969741 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-21d3816e-e1ab-4276-9f46-e107f8eaf497 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:34.109558 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-21d3816e-e1ab-4276-9f46-e107f8eaf497 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:34.117611 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-21d3816e-e1ab-4276-9f46-e107f8eaf497 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.161392 Jul 12 07:14:34.118190 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 117/240] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:33 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:34.416576 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1879dbd2-bc9c-412c-bd84-afb79d4241ae tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:34.417164 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1879dbd2-bc9c-412c-bd84-afb79d4241ae tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:34.424514 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1879dbd2-bc9c-412c-bd84-afb79d4241ae tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:34.425022 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1879dbd2-bc9c-412c-bd84-afb79d4241ae tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:34.425869 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1879dbd2-bc9c-412c-bd84-afb79d4241ae tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:34.426364 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1879dbd2-bc9c-412c-bd84-afb79d4241ae tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:34.451545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1879dbd2-bc9c-412c-bd84-afb79d4241ae tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:14:34.550424 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1879dbd2-bc9c-412c-bd84-afb79d4241ae tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 204 len: 0 microversion: 2.1 time: 0.137655 Jul 12 07:14:34.551104 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 124/241] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:14:34 2022] DELETE /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:14:34.560269 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5c849d49-5f80-4627-b796-cd86c7e18cd3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:34.561008 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5c849d49-5f80-4627-b796-cd86c7e18cd3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:34.568860 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c849d49-5f80-4627-b796-cd86c7e18cd3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:34.569402 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c849d49-5f80-4627-b796-cd86c7e18cd3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:34.570260 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c849d49-5f80-4627-b796-cd86c7e18cd3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:34.570802 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c849d49-5f80-4627-b796-cd86c7e18cd3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:34.736973 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5c849d49-5f80-4627-b796-cd86c7e18cd3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:34.747167 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5c849d49-5f80-4627-b796-cd86c7e18cd3 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1554 microversion: 2.1 time: 0.191053 Jul 12 07:14:34.747774 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 118/242] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:34 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:35.138689 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3e09e415-c393-4102-92fd-b40a373e7327 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:35.139799 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3e09e415-c393-4102-92fd-b40a373e7327 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:35.145604 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:35.148727 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3e09e415-c393-4102-92fd-b40a373e7327 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:35.149460 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3e09e415-c393-4102-92fd-b40a373e7327 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:35.150421 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3e09e415-c393-4102-92fd-b40a373e7327 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:35.151035 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3e09e415-c393-4102-92fd-b40a373e7327 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:35.174208 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:35.389835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3e09e415-c393-4102-92fd-b40a373e7327 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:35.399328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3e09e415-c393-4102-92fd-b40a373e7327 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.266622 Jul 12 07:14:35.400189 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 125/243] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:35 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:35.764321 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ce7fca20-312b-46d7-a1bd-1e6fd1d3f3ee tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:35.765934 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ce7fca20-312b-46d7-a1bd-1e6fd1d3f3ee tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:35.776746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce7fca20-312b-46d7-a1bd-1e6fd1d3f3ee tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:35.777470 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce7fca20-312b-46d7-a1bd-1e6fd1d3f3ee tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:35.778401 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce7fca20-312b-46d7-a1bd-1e6fd1d3f3ee tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:35.778977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce7fca20-312b-46d7-a1bd-1e6fd1d3f3ee tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:36.012374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ce7fca20-312b-46d7-a1bd-1e6fd1d3f3ee tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:36.038092 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ce7fca20-312b-46d7-a1bd-1e6fd1d3f3ee tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1554 microversion: 2.1 time: 0.277987 Jul 12 07:14:36.054125 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 119/244] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:35 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1554 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:36.420224 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0d1c4ec0-146f-4e63-abd8-64f12dbd396b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:36.421066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0d1c4ec0-146f-4e63-abd8-64f12dbd396b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:36.429018 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d1c4ec0-146f-4e63-abd8-64f12dbd396b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:36.430134 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d1c4ec0-146f-4e63-abd8-64f12dbd396b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:36.431119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d1c4ec0-146f-4e63-abd8-64f12dbd396b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:36.432053 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d1c4ec0-146f-4e63-abd8-64f12dbd396b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:36.613419 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0d1c4ec0-146f-4e63-abd8-64f12dbd396b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:36.624611 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0d1c4ec0-146f-4e63-abd8-64f12dbd396b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.209751 Jul 12 07:14:36.625944 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 126/245] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:36 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:37.060842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cdc3db19-fd72-4c39-b23d-bde8e03f8519 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:37.062135 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cdc3db19-fd72-4c39-b23d-bde8e03f8519 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:37.070528 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cdc3db19-fd72-4c39-b23d-bde8e03f8519 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:37.071365 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cdc3db19-fd72-4c39-b23d-bde8e03f8519 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:37.072356 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cdc3db19-fd72-4c39-b23d-bde8e03f8519 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:37.074206 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cdc3db19-fd72-4c39-b23d-bde8e03f8519 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:37.280424 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cdc3db19-fd72-4c39-b23d-bde8e03f8519 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:37.294142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cdc3db19-fd72-4c39-b23d-bde8e03f8519 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1554 microversion: 2.1 time: 0.236938 Jul 12 07:14:37.306821 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 120/246] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:37 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:37.642837 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4d30db22-4087-44ba-b2e1-0f60df1ac456 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:37.644069 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4d30db22-4087-44ba-b2e1-0f60df1ac456 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:37.651140 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d30db22-4087-44ba-b2e1-0f60df1ac456 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:37.652205 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d30db22-4087-44ba-b2e1-0f60df1ac456 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:37.652569 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d30db22-4087-44ba-b2e1-0f60df1ac456 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:37.659852 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d30db22-4087-44ba-b2e1-0f60df1ac456 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:37.898838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4d30db22-4087-44ba-b2e1-0f60df1ac456 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:37.907962 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4d30db22-4087-44ba-b2e1-0f60df1ac456 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.269002 Jul 12 07:14:37.909230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 127/247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:37 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:38.104467 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-4b7327d4-cd73-40dc-ad04-1385acc7feea req-94dceab1-d93c-47d3-8a9e-ad09306c34fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14bfba8-c99f-4905-8313-a0f83ba9a1e0", "name": "network-vif-deleted", "tag": "7d978e15-5dca-4e8f-bd74-442e479f7431"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:38.116155 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4b7327d4-cd73-40dc-ad04-1385acc7feea req-94dceab1-d93c-47d3-8a9e-ad09306c34fb service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:38.121576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4b7327d4-cd73-40dc-ad04-1385acc7feea req-94dceab1-d93c-47d3-8a9e-ad09306c34fb service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:38.144141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-4b7327d4-cd73-40dc-ad04-1385acc7feea req-94dceab1-d93c-47d3-8a9e-ad09306c34fb service nova] Creating event network-vif-deleted:7d978e15-5dca-4e8f-bd74-442e479f7431 for instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 on hv-cinder-82549 Jul 12 07:14:38.155750 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-4b7327d4-cd73-40dc-ad04-1385acc7feea req-94dceab1-d93c-47d3-8a9e-ad09306c34fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055142 Jul 12 07:14:38.156691 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 121/248] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:14:38.315806 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-797f19cb-976a-4c05-b4bc-a7b5fe948c7f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:38.316585 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-797f19cb-976a-4c05-b4bc-a7b5fe948c7f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:38.324444 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-797f19cb-976a-4c05-b4bc-a7b5fe948c7f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:38.327634 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-797f19cb-976a-4c05-b4bc-a7b5fe948c7f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:38.331412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-797f19cb-976a-4c05-b4bc-a7b5fe948c7f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:38.331876 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-797f19cb-976a-4c05-b4bc-a7b5fe948c7f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:38.437838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-797f19cb-976a-4c05-b4bc-a7b5fe948c7f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fe433179944b2b234ae9f164e8133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1156aa267ff456b849a9fd0c1a43357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:38.447831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-797f19cb-976a-4c05-b4bc-a7b5fe948c7f tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 200 len: 1345 microversion: 2.1 time: 0.135640 Jul 12 07:14:38.449117 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 128/249] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:38 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 1345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:38.927127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2df52279-91e9-4643-a63a-6626ce344ce4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:38.927912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2df52279-91e9-4643-a63a-6626ce344ce4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:38.942311 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2df52279-91e9-4643-a63a-6626ce344ce4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:38.942842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2df52279-91e9-4643-a63a-6626ce344ce4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:38.943839 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2df52279-91e9-4643-a63a-6626ce344ce4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:38.944458 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2df52279-91e9-4643-a63a-6626ce344ce4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:39.180856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2df52279-91e9-4643-a63a-6626ce344ce4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:39.199892 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2df52279-91e9-4643-a63a-6626ce344ce4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.276994 Jul 12 07:14:39.201001 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 122/250] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:38 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:39.466704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:39.468012 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:39.475290 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:39.475834 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:39.476959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:39.477500 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:39.495837 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] HTTP exception thrown: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Request method failure captured: Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 HTTP/1.1 Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8OFgyKLau7K4Ww1WARBd3NfCgcIMKq_tcW8kM949lBxoOYAmPnrpJFSrmHEX0iNvu9Tu8glebOu9n4t3Pl_nNX3q9IT1eo2MBV1ja_ekUxgLjQsLbeO2ihCLj1Pc7smGk7MDZYJN_t8YpnmWhU2b2AXo-lnfPupzF82VG-c8yvsaE Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: c1156aa267ff456b849a9fd0c1a43357 Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:14:39.501831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c1156aa267ff456b849a9fd0c1a43357"}]}] Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: c1156aa267ff456b849a9fd0c1a43357 Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-DeleteServersTestJSON-117013690-project Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 8f1fe433179944b2b234ae9f164e8133 Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-DeleteServersTestJSON-117013690-project Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.503126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'd14bfba8-c99f-4905-8313-a0f83ba9a1e0'} Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:14:39.503830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.504966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.506342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Returning 404 to user: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:14:39.506342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f1b1d6dc-efae-4a55-b5ac-63674850beff tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 404 len: 111 microversion: 2.1 time: 0.041427 Jul 12 07:14:39.507870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 129/251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:39 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:14:39.646249 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:39.649519 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:39.671821 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:39.672960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:39.673929 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:39.674986 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:39.692971 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] HTTP exception thrown: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Request method failure captured: Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0/os-volume_attachments HTTP/1.1 Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8OFgyKLau7K4Ww1WARBd3NfCgcIMKq_tcW8kM949lBxoOYAmPnrpJFSrmHEX0iNvu9Tu8glebOu9n4t3Pl_nNX3q9IT1eo2MBV1ja_ekUxgLjQsLbeO2ihCLj1Pc7smGk7MDZYJN_t8YpnmWhU2b2AXo-lnfPupzF82VG-c8yvsaE Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: c1156aa267ff456b849a9fd0c1a43357 Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:14:39.698247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c1156aa267ff456b849a9fd0c1a43357"}]}] Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: c1156aa267ff456b849a9fd0c1a43357 Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-DeleteServersTestJSON-117013690-project Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 8f1fe433179944b2b234ae9f164e8133 Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-DeleteServersTestJSON-117013690-project Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.699740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'server_id': 'd14bfba8-c99f-4905-8313-a0f83ba9a1e0'} Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:14:39.700568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:39.702157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:39.710690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Returning 404 to user: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:14:39.712064 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d292b1eb-194f-47f0-a554-e12cdca663d7 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071685 Jul 12 07:14:39.712974 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 123/252] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:14:39 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0/os-volume_attachments => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:14:40.218667 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b8740fc0-4828-412e-87fa-6d661332d0bc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:40.219617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b8740fc0-4828-412e-87fa-6d661332d0bc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:40.228979 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b8740fc0-4828-412e-87fa-6d661332d0bc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:40.229560 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b8740fc0-4828-412e-87fa-6d661332d0bc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:40.230608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b8740fc0-4828-412e-87fa-6d661332d0bc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:40.231505 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b8740fc0-4828-412e-87fa-6d661332d0bc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:40.411255 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b8740fc0-4828-412e-87fa-6d661332d0bc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:40.422348 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b8740fc0-4828-412e-87fa-6d661332d0bc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.208439 Jul 12 07:14:40.423291 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 130/253] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:40 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:41.089231 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:41.089801 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:41.110892 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:41.111338 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:41.112826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:41.113358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:41.172985 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] HTTP exception thrown: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Request method failure captured: Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: DELETE /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 HTTP/1.1 Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8OFgyKLau7K4Ww1WARBd3NfCgcIMKq_tcW8kM949lBxoOYAmPnrpJFSrmHEX0iNvu9Tu8glebOu9n4t3Pl_nNX3q9IT1eo2MBV1ja_ekUxgLjQsLbeO2ihCLj1Pc7smGk7MDZYJN_t8YpnmWhU2b2AXo-lnfPupzF82VG-c8yvsaE Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: c1156aa267ff456b849a9fd0c1a43357 Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:14:41.185383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c1156aa267ff456b849a9fd0c1a43357"}]}] Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: c1156aa267ff456b849a9fd0c1a43357 Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-DeleteServersTestJSON-117013690-project Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 8f1fe433179944b2b234ae9f164e8133 Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-DeleteServersTestJSON-117013690-project Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.186775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'd14bfba8-c99f-4905-8313-a0f83ba9a1e0'} Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:14:41.187604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.188822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.189969 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Returning 404 to user: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:14:41.194047 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0203f4e4-fac8-404b-a382-a714ebf7afdb tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 404 len: 111 microversion: 2.1 time: 0.113179 Jul 12 07:14:41.195855 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 124/254] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:14:41 2022] DELETE /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:14:41.204839 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:41.205631 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] [instance: d14bfba8-c99f-4905-8313-a0f83ba9a1e0] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:41.214947 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:41.215896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:41.216681 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:41.217135 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:41.381374 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] HTTP exception thrown: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Request method failure captured: Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 HTTP/1.1 Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8OFgyKLau7K4Ww1WARBd3NfCgcIMKq_tcW8kM949lBxoOYAmPnrpJFSrmHEX0iNvu9Tu8glebOu9n4t3Pl_nNX3q9IT1eo2MBV1ja_ekUxgLjQsLbeO2ihCLj1Pc7smGk7MDZYJN_t8YpnmWhU2b2AXo-lnfPupzF82VG-c8yvsaE Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: c1156aa267ff456b849a9fd0c1a43357 Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:14:41.384345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c1156aa267ff456b849a9fd0c1a43357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c1156aa267ff456b849a9fd0c1a43357"}]}] Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: c1156aa267ff456b849a9fd0c1a43357 Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-DeleteServersTestJSON-117013690 Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-DeleteServersTestJSON-117013690-project Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 8f1fe433179944b2b234ae9f164e8133 Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-DeleteServersTestJSON-117013690-project Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.387773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'd14bfba8-c99f-4905-8313-a0f83ba9a1e0'} Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:14:41.389228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. Jul 12 07:14:41.391308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:14:41.394453 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] Returning 404 to user: Instance d14bfba8-c99f-4905-8313-a0f83ba9a1e0 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:14:41.396649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4a0217ae-d8fc-447e-87a3-a1fb0cd32648 tempest-DeleteServersTestJSON-117013690 tempest-DeleteServersTestJSON-117013690-project] 10.222.0.25 "GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0" status: 404 len: 111 microversion: 2.1 time: 0.195879 Jul 12 07:14:41.398237 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 131/255] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:41 2022] GET /compute/v2.1/servers/d14bfba8-c99f-4905-8313-a0f83ba9a1e0 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:14:41.439532 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c2cd9d68-a2dd-44c3-9f1f-1e7a11f969f8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:41.440137 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c2cd9d68-a2dd-44c3-9f1f-1e7a11f969f8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:41.446456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2cd9d68-a2dd-44c3-9f1f-1e7a11f969f8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:41.446902 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2cd9d68-a2dd-44c3-9f1f-1e7a11f969f8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:41.447648 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2cd9d68-a2dd-44c3-9f1f-1e7a11f969f8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:41.448078 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2cd9d68-a2dd-44c3-9f1f-1e7a11f969f8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:41.625131 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c2cd9d68-a2dd-44c3-9f1f-1e7a11f969f8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:41.628854 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:41.637955 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c2cd9d68-a2dd-44c3-9f1f-1e7a11f969f8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.202174 Jul 12 07:14:41.653667 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 125/256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:41 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:42.656205 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d79ded4c-6475-48f0-aaa2-e39e40317f84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:42.657598 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d79ded4c-6475-48f0-aaa2-e39e40317f84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:42.667505 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d79ded4c-6475-48f0-aaa2-e39e40317f84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:42.668761 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d79ded4c-6475-48f0-aaa2-e39e40317f84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:42.669917 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d79ded4c-6475-48f0-aaa2-e39e40317f84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:42.671346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d79ded4c-6475-48f0-aaa2-e39e40317f84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:43.272448 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d79ded4c-6475-48f0-aaa2-e39e40317f84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:43.280136 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d79ded4c-6475-48f0-aaa2-e39e40317f84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.629106 Jul 12 07:14:43.289566 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 132/257] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:42 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:44.297344 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bf7b63f5-52d8-4e34-b916-908127bb1550 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:44.298466 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bf7b63f5-52d8-4e34-b916-908127bb1550 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:44.310841 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf7b63f5-52d8-4e34-b916-908127bb1550 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:44.313609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf7b63f5-52d8-4e34-b916-908127bb1550 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:44.316719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf7b63f5-52d8-4e34-b916-908127bb1550 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:44.317342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf7b63f5-52d8-4e34-b916-908127bb1550 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:44.954237 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bf7b63f5-52d8-4e34-b916-908127bb1550 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:44.972298 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bf7b63f5-52d8-4e34-b916-908127bb1550 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.679369 Jul 12 07:14:44.974013 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 126/258] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:44 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:45.998388 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f38f9e1b-cfab-4b3b-90e4-5076854b70a3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:45.999616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f38f9e1b-cfab-4b3b-90e4-5076854b70a3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:46.065401 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f38f9e1b-cfab-4b3b-90e4-5076854b70a3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:46.067293 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f38f9e1b-cfab-4b3b-90e4-5076854b70a3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:46.072154 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f38f9e1b-cfab-4b3b-90e4-5076854b70a3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:46.076257 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f38f9e1b-cfab-4b3b-90e4-5076854b70a3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:46.478704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f38f9e1b-cfab-4b3b-90e4-5076854b70a3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:46.492476 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f38f9e1b-cfab-4b3b-90e4-5076854b70a3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.505160 Jul 12 07:14:46.502336 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 133/259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:45 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:47.448271 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-50636fdb-37b5-47a0-8dab-bcb35f5ef84a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Action: 'create', calling method: .version_select at 0x7f70118c0280>, body: {"keypair": {"name": "tempest-TestShelveInstance-866755811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV5z7o1OGj5V4gN3p8CRyjDOKgvKfgzBUX9s+6NGJ+y1PqCIKzD1zgfbnByT8ASDccjpMiswIM6FbJz7z7M5Uic5fn2z70RyysTEZ3v+mKJJqo/tQnSK30wV7mwCIpE1A=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:14:47.465000 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-50636fdb-37b5-47a0-8dab-bcb35f5ef84a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Getting quotas for project 04a2e6cc3cbd4691a33722b5d058e82b. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:14:47.469574 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-50636fdb-37b5-47a0-8dab-bcb35f5ef84a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Getting quotas for user 516ee78e2f9c43b195ad64b7a1d68624 and project 04a2e6cc3cbd4691a33722b5d058e82b. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:14:47.495149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-50636fdb-37b5-47a0-8dab-bcb35f5ef84a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.315046 Jul 12 07:14:47.495767 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 127/260] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:14:47 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:14:47.510874 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-72d59161-4e5b-49ae-8ed0-f492ff8d82b3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:47.511484 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-72d59161-4e5b-49ae-8ed0-f492ff8d82b3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:47.526891 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72d59161-4e5b-49ae-8ed0-f492ff8d82b3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:47.527338 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72d59161-4e5b-49ae-8ed0-f492ff8d82b3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:47.528119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72d59161-4e5b-49ae-8ed0-f492ff8d82b3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:47.528546 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72d59161-4e5b-49ae-8ed0-f492ff8d82b3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:47.761155 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-72d59161-4e5b-49ae-8ed0-f492ff8d82b3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:47.799679 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-72d59161-4e5b-49ae-8ed0-f492ff8d82b3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.293453 Jul 12 07:14:47.810187 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 134/261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:47 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:48.821082 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35d2a7bd-2718-4ab2-b592-00ecc27ef0d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:48.822395 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-35d2a7bd-2718-4ab2-b592-00ecc27ef0d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:48.829131 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35d2a7bd-2718-4ab2-b592-00ecc27ef0d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:48.829908 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35d2a7bd-2718-4ab2-b592-00ecc27ef0d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:48.830906 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35d2a7bd-2718-4ab2-b592-00ecc27ef0d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:48.831520 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35d2a7bd-2718-4ab2-b592-00ecc27ef0d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:48.982038 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-35d2a7bd-2718-4ab2-b592-00ecc27ef0d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:48.989880 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-35d2a7bd-2718-4ab2-b592-00ecc27ef0d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.173713 Jul 12 07:14:48.990783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 128/262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:48 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:50.012151 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-477bcf6a-a2b9-40f2-af2e-71663d4ce55b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:50.013170 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-477bcf6a-a2b9-40f2-af2e-71663d4ce55b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:50.023908 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-477bcf6a-a2b9-40f2-af2e-71663d4ce55b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:50.024348 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-477bcf6a-a2b9-40f2-af2e-71663d4ce55b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:50.025095 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-477bcf6a-a2b9-40f2-af2e-71663d4ce55b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:50.025554 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-477bcf6a-a2b9-40f2-af2e-71663d4ce55b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:50.176215 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-477bcf6a-a2b9-40f2-af2e-71663d4ce55b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:50.183936 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-477bcf6a-a2b9-40f2-af2e-71663d4ce55b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.178820 Jul 12 07:14:50.184472 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 135/263] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:50 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:51.203379 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-34e8b776-58d6-401a-8aea-6116ad2a29fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:51.204385 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-34e8b776-58d6-401a-8aea-6116ad2a29fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:51.207351 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:51.215758 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34e8b776-58d6-401a-8aea-6116ad2a29fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:51.216348 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34e8b776-58d6-401a-8aea-6116ad2a29fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:51.217672 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34e8b776-58d6-401a-8aea-6116ad2a29fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:51.218752 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34e8b776-58d6-401a-8aea-6116ad2a29fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:51.404811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-34e8b776-58d6-401a-8aea-6116ad2a29fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:51.413631 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-34e8b776-58d6-401a-8aea-6116ad2a29fa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.216276 Jul 12 07:14:51.414210 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 129/264] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:51 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:52.431878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2c8aa569-3457-4a9f-8bd8-32330f45bfdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:52.432661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2c8aa569-3457-4a9f-8bd8-32330f45bfdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:52.445948 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2c8aa569-3457-4a9f-8bd8-32330f45bfdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:52.447378 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2c8aa569-3457-4a9f-8bd8-32330f45bfdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:52.449092 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2c8aa569-3457-4a9f-8bd8-32330f45bfdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:52.449889 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2c8aa569-3457-4a9f-8bd8-32330f45bfdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:52.731174 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2c8aa569-3457-4a9f-8bd8-32330f45bfdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:52.744498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2c8aa569-3457-4a9f-8bd8-32330f45bfdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.316268 Jul 12 07:14:52.747240 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 136/265] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:52 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:53.762811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d871efa5-e6b9-4cf9-bb49-9422a40e8d7b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:53.763419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d871efa5-e6b9-4cf9-bb49-9422a40e8d7b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:53.770027 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d871efa5-e6b9-4cf9-bb49-9422a40e8d7b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:53.770477 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d871efa5-e6b9-4cf9-bb49-9422a40e8d7b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:53.771235 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d871efa5-e6b9-4cf9-bb49-9422a40e8d7b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:53.771803 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d871efa5-e6b9-4cf9-bb49-9422a40e8d7b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:53.916153 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d871efa5-e6b9-4cf9-bb49-9422a40e8d7b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:53.924005 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d871efa5-e6b9-4cf9-bb49-9422a40e8d7b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.165362 Jul 12 07:14:53.924598 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 130/266] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:53 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:54.942266 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-27b54296-106c-439e-b541-c3e42e529e62 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:54.943680 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-27b54296-106c-439e-b541-c3e42e529e62 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:54.950894 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-27b54296-106c-439e-b541-c3e42e529e62 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:54.951338 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-27b54296-106c-439e-b541-c3e42e529e62 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:54.952100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-27b54296-106c-439e-b541-c3e42e529e62 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:54.952509 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-27b54296-106c-439e-b541-c3e42e529e62 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:55.093556 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-27b54296-106c-439e-b541-c3e42e529e62 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:55.101540 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-27b54296-106c-439e-b541-c3e42e529e62 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.164166 Jul 12 07:14:55.102110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 137/267] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:54 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:56.121747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-565d3536-be19-4204-b3d1-f558b8260f32 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:56.122381 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-565d3536-be19-4204-b3d1-f558b8260f32 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:56.130074 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-565d3536-be19-4204-b3d1-f558b8260f32 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:56.130585 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-565d3536-be19-4204-b3d1-f558b8260f32 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:56.131466 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-565d3536-be19-4204-b3d1-f558b8260f32 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:56.131967 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-565d3536-be19-4204-b3d1-f558b8260f32 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:56.269806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-565d3536-be19-4204-b3d1-f558b8260f32 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:56.277521 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-565d3536-be19-4204-b3d1-f558b8260f32 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.160921 Jul 12 07:14:56.278064 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 131/268] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:56 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:57.295452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b324cbb4-dd6a-47bf-9b64-84f39aa992bf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:57.296036 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b324cbb4-dd6a-47bf-9b64-84f39aa992bf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:57.303038 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b324cbb4-dd6a-47bf-9b64-84f39aa992bf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:57.303484 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b324cbb4-dd6a-47bf-9b64-84f39aa992bf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:57.304236 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b324cbb4-dd6a-47bf-9b64-84f39aa992bf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:57.304673 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b324cbb4-dd6a-47bf-9b64-84f39aa992bf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:57.444100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b324cbb4-dd6a-47bf-9b64-84f39aa992bf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:57.452261 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b324cbb4-dd6a-47bf-9b64-84f39aa992bf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.161132 Jul 12 07:14:57.452857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 138/269] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:57 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:58.469493 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17c6dbbe-c49b-4613-ab6d-4dd0de1ba1d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:58.470057 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17c6dbbe-c49b-4613-ab6d-4dd0de1ba1d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:58.471974 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=4 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:14:58.477885 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17c6dbbe-c49b-4613-ab6d-4dd0de1ba1d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:58.478330 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17c6dbbe-c49b-4613-ab6d-4dd0de1ba1d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:58.479082 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17c6dbbe-c49b-4613-ab6d-4dd0de1ba1d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:58.479503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17c6dbbe-c49b-4613-ab6d-4dd0de1ba1d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:58.621971 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-17c6dbbe-c49b-4613-ab6d-4dd0de1ba1d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:58.629836 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17c6dbbe-c49b-4613-ab6d-4dd0de1ba1d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.164212 Jul 12 07:14:58.630424 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 132/270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:58 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:14:59.647478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-141c2c37-adec-4c39-b2f5-956112b3c589 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:14:59.648181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-141c2c37-adec-4c39-b2f5-956112b3c589 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:14:59.655381 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-141c2c37-adec-4c39-b2f5-956112b3c589 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:59.655822 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-141c2c37-adec-4c39-b2f5-956112b3c589 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:59.656606 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-141c2c37-adec-4c39-b2f5-956112b3c589 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:14:59.657036 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-141c2c37-adec-4c39-b2f5-956112b3c589 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:14:59.794118 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-141c2c37-adec-4c39-b2f5-956112b3c589 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:14:59.802230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-141c2c37-adec-4c39-b2f5-956112b3c589 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.158774 Jul 12 07:14:59.802807 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 139/271] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:14:59 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:00.821687 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-50817c70-5d3f-41c4-9e4d-4bad1fa70d7a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:00.822914 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-50817c70-5d3f-41c4-9e4d-4bad1fa70d7a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:00.830480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50817c70-5d3f-41c4-9e4d-4bad1fa70d7a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:00.830946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50817c70-5d3f-41c4-9e4d-4bad1fa70d7a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:00.831715 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50817c70-5d3f-41c4-9e4d-4bad1fa70d7a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:00.837071 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50817c70-5d3f-41c4-9e4d-4bad1fa70d7a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:00.992248 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-50817c70-5d3f-41c4-9e4d-4bad1fa70d7a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:01.001930 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-50817c70-5d3f-41c4-9e4d-4bad1fa70d7a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.185431 Jul 12 07:15:01.003116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 133/272] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:00 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:02.019757 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6b2c800f-d934-4e0d-8d19-043ef56e5205 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:02.020644 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6b2c800f-d934-4e0d-8d19-043ef56e5205 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:02.027171 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b2c800f-d934-4e0d-8d19-043ef56e5205 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:02.027613 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b2c800f-d934-4e0d-8d19-043ef56e5205 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:02.030262 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b2c800f-d934-4e0d-8d19-043ef56e5205 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:02.030262 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6b2c800f-d934-4e0d-8d19-043ef56e5205 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:02.172670 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6b2c800f-d934-4e0d-8d19-043ef56e5205 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:02.180223 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6b2c800f-d934-4e0d-8d19-043ef56e5205 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.164613 Jul 12 07:15:02.180797 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 140/273] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:02 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:03.197110 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e7720cb3-419f-46bc-a214-a9f9384ddc5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:03.198383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e7720cb3-419f-46bc-a214-a9f9384ddc5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:03.204639 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7720cb3-419f-46bc-a214-a9f9384ddc5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:03.205117 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7720cb3-419f-46bc-a214-a9f9384ddc5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:03.205977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7720cb3-419f-46bc-a214-a9f9384ddc5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:03.206405 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7720cb3-419f-46bc-a214-a9f9384ddc5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:03.400916 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7720cb3-419f-46bc-a214-a9f9384ddc5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:03.409820 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e7720cb3-419f-46bc-a214-a9f9384ddc5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1522 microversion: 2.1 time: 0.215805 Jul 12 07:15:03.410479 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 134/274] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:03 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:04.427782 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-874aefd4-28b9-49dd-9f2a-0c1829436800 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:04.428660 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-874aefd4-28b9-49dd-9f2a-0c1829436800 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:04.436131 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-874aefd4-28b9-49dd-9f2a-0c1829436800 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:04.436654 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-874aefd4-28b9-49dd-9f2a-0c1829436800 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:04.437615 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-874aefd4-28b9-49dd-9f2a-0c1829436800 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:04.438057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-874aefd4-28b9-49dd-9f2a-0c1829436800 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:04.834227 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-874aefd4-28b9-49dd-9f2a-0c1829436800 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:04.841084 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-874aefd4-28b9-49dd-9f2a-0c1829436800 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1502 microversion: 2.1 time: 0.417882 Jul 12 07:15:04.841656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 141/275] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:04 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1502 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:04.857757 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-db0657b5-9896-4ece-b628-f70b5fecc8e4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:04.858364 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-db0657b5-9896-4ece-b628-f70b5fecc8e4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:04.866706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db0657b5-9896-4ece-b628-f70b5fecc8e4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:04.867364 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db0657b5-9896-4ece-b628-f70b5fecc8e4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:04.868529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db0657b5-9896-4ece-b628-f70b5fecc8e4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:04.869111 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db0657b5-9896-4ece-b628-f70b5fecc8e4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:05.010636 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-db0657b5-9896-4ece-b628-f70b5fecc8e4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:05.018164 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-db0657b5-9896-4ece-b628-f70b5fecc8e4 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1517 microversion: 2.1 time: 0.164224 Jul 12 07:15:05.028342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 135/276] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:04 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:06.451471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f66dc136-61bb-4a83-ac01-fdd1f33e65c3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:06.452456 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f66dc136-61bb-4a83-ac01-fdd1f33e65c3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:06.454802 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=34 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:06.460394 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f66dc136-61bb-4a83-ac01-fdd1f33e65c3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:06.460836 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f66dc136-61bb-4a83-ac01-fdd1f33e65c3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:06.461625 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f66dc136-61bb-4a83-ac01-fdd1f33e65c3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:06.462044 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f66dc136-61bb-4a83-ac01-fdd1f33e65c3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:06.466093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=91 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:06.487430 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-f66dc136-61bb-4a83-ac01-fdd1f33e65c3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lazy-loading 'flavor' on Instance uuid 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:15:06.603066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f66dc136-61bb-4a83-ac01-fdd1f33e65c3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89/action" status: 200 len: 32 microversion: 2.1 time: 0.155517 Jul 12 07:15:06.603679 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 142/277] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:15:06 2022] POST /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:15:06.612884 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fce20755-ecdc-47ac-b0f2-5ad2d97832db tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:06.613503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fce20755-ecdc-47ac-b0f2-5ad2d97832db tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:06.619917 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fce20755-ecdc-47ac-b0f2-5ad2d97832db tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:06.620386 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fce20755-ecdc-47ac-b0f2-5ad2d97832db tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:06.621267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fce20755-ecdc-47ac-b0f2-5ad2d97832db tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:06.621701 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fce20755-ecdc-47ac-b0f2-5ad2d97832db tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:06.850294 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fce20755-ecdc-47ac-b0f2-5ad2d97832db tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:06.858928 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fce20755-ecdc-47ac-b0f2-5ad2d97832db tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.250037 Jul 12 07:15:06.859514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 136/278] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:06 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:07.878916 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-73585d5b-a3f9-4ebe-b72e-dc48c597b852 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:07.879632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-73585d5b-a3f9-4ebe-b72e-dc48c597b852 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:07.886829 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-73585d5b-a3f9-4ebe-b72e-dc48c597b852 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:07.887386 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-73585d5b-a3f9-4ebe-b72e-dc48c597b852 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:07.888431 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-73585d5b-a3f9-4ebe-b72e-dc48c597b852 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:07.888722 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-73585d5b-a3f9-4ebe-b72e-dc48c597b852 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:08.031028 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-73585d5b-a3f9-4ebe-b72e-dc48c597b852 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:08.039278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-73585d5b-a3f9-4ebe-b72e-dc48c597b852 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.164978 Jul 12 07:15:08.039862 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 143/279] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:07 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:09.056837 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b4ee1de1-8574-4459-966d-27a82e037ec3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:09.057480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b4ee1de1-8574-4459-966d-27a82e037ec3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:09.064057 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4ee1de1-8574-4459-966d-27a82e037ec3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:09.064502 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4ee1de1-8574-4459-966d-27a82e037ec3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:09.065295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4ee1de1-8574-4459-966d-27a82e037ec3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:09.065924 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4ee1de1-8574-4459-966d-27a82e037ec3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:09.200718 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b4ee1de1-8574-4459-966d-27a82e037ec3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:09.208280 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b4ee1de1-8574-4459-966d-27a82e037ec3 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.155687 Jul 12 07:15:09.208845 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 137/280] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:09 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:10.226170 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6db152b3-870b-44da-a2d2-0885640de3d5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:10.226776 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6db152b3-870b-44da-a2d2-0885640de3d5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:10.234558 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6db152b3-870b-44da-a2d2-0885640de3d5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:10.235003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6db152b3-870b-44da-a2d2-0885640de3d5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:10.235919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6db152b3-870b-44da-a2d2-0885640de3d5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:10.236354 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6db152b3-870b-44da-a2d2-0885640de3d5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:10.375410 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6db152b3-870b-44da-a2d2-0885640de3d5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:10.383692 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6db152b3-870b-44da-a2d2-0885640de3d5 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.161652 Jul 12 07:15:10.384258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 144/281] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:10 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:11.400158 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a6120c2-7a48-4c2b-ba32-907350d67c77 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:11.400823 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a6120c2-7a48-4c2b-ba32-907350d67c77 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:11.407405 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a6120c2-7a48-4c2b-ba32-907350d67c77 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:11.407853 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a6120c2-7a48-4c2b-ba32-907350d67c77 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:11.408606 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a6120c2-7a48-4c2b-ba32-907350d67c77 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:11.409026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a6120c2-7a48-4c2b-ba32-907350d67c77 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:11.552156 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9a6120c2-7a48-4c2b-ba32-907350d67c77 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:11.559753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a6120c2-7a48-4c2b-ba32-907350d67c77 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.163463 Jul 12 07:15:11.560280 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 138/282] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:11 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:12.577011 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5f271759-9ab2-42f9-9202-d694c12095af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:12.577642 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5f271759-9ab2-42f9-9202-d694c12095af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:12.584360 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f271759-9ab2-42f9-9202-d694c12095af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:12.584850 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f271759-9ab2-42f9-9202-d694c12095af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:12.585778 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f271759-9ab2-42f9-9202-d694c12095af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:12.586191 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f271759-9ab2-42f9-9202-d694c12095af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:12.766043 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5f271759-9ab2-42f9-9202-d694c12095af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:12.774329 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5f271759-9ab2-42f9-9202-d694c12095af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.201196 Jul 12 07:15:12.775249 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 145/283] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:12 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:13.792406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1e252d28-ba28-4f21-b802-c8c06e102314 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:13.793040 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1e252d28-ba28-4f21-b802-c8c06e102314 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:13.799960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e252d28-ba28-4f21-b802-c8c06e102314 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:13.800397 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e252d28-ba28-4f21-b802-c8c06e102314 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:13.801175 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e252d28-ba28-4f21-b802-c8c06e102314 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:13.801593 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e252d28-ba28-4f21-b802-c8c06e102314 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:13.935474 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1e252d28-ba28-4f21-b802-c8c06e102314 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:13.943277 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1e252d28-ba28-4f21-b802-c8c06e102314 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.155312 Jul 12 07:15:13.943845 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 139/284] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:13 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:14.961380 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c7e524a6-07d0-4cc9-abfd-b56a2a4d38d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:14.962210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c7e524a6-07d0-4cc9-abfd-b56a2a4d38d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:14.969036 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c7e524a6-07d0-4cc9-abfd-b56a2a4d38d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:14.969533 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c7e524a6-07d0-4cc9-abfd-b56a2a4d38d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:14.970381 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c7e524a6-07d0-4cc9-abfd-b56a2a4d38d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:14.970809 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c7e524a6-07d0-4cc9-abfd-b56a2a4d38d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:15.198630 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c7e524a6-07d0-4cc9-abfd-b56a2a4d38d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:15.206885 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c7e524a6-07d0-4cc9-abfd-b56a2a4d38d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.250047 Jul 12 07:15:15.207544 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 146/285] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:14 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:16.225899 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6f4662c8-c82a-4caa-9032-4d148c71d726 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:16.226545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6f4662c8-c82a-4caa-9032-4d148c71d726 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:16.232896 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f4662c8-c82a-4caa-9032-4d148c71d726 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:16.233380 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f4662c8-c82a-4caa-9032-4d148c71d726 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:16.234103 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f4662c8-c82a-4caa-9032-4d148c71d726 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:16.234523 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f4662c8-c82a-4caa-9032-4d148c71d726 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:16.237091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=79 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:16.373962 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6f4662c8-c82a-4caa-9032-4d148c71d726 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:16.381763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6f4662c8-c82a-4caa-9032-4d148c71d726 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.159786 Jul 12 07:15:16.386499 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 140/286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:16 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:17.398676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-80f9e055-42d5-4f33-8150-ffbe2f729779 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:17.399312 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-80f9e055-42d5-4f33-8150-ffbe2f729779 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:17.405883 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-80f9e055-42d5-4f33-8150-ffbe2f729779 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:17.406291 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-80f9e055-42d5-4f33-8150-ffbe2f729779 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:17.407171 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-80f9e055-42d5-4f33-8150-ffbe2f729779 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:17.407496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-80f9e055-42d5-4f33-8150-ffbe2f729779 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:17.563871 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-80f9e055-42d5-4f33-8150-ffbe2f729779 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:17.573435 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-80f9e055-42d5-4f33-8150-ffbe2f729779 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.178608 Jul 12 07:15:17.574007 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 147/287] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:17 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:18.590853 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2bc3512a-1d06-4694-876a-a54e64c67e27 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:18.591514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2bc3512a-1d06-4694-876a-a54e64c67e27 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:18.598259 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2bc3512a-1d06-4694-876a-a54e64c67e27 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:18.598694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2bc3512a-1d06-4694-876a-a54e64c67e27 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:18.599442 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2bc3512a-1d06-4694-876a-a54e64c67e27 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:18.599862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2bc3512a-1d06-4694-876a-a54e64c67e27 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:18.739186 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2bc3512a-1d06-4694-876a-a54e64c67e27 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:18.746840 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2bc3512a-1d06-4694-876a-a54e64c67e27 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.160091 Jul 12 07:15:18.747437 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 141/288] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:18 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:19.763816 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-99ed45ca-919e-4812-8904-bcb2d4a05baf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:19.764401 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-99ed45ca-919e-4812-8904-bcb2d4a05baf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:19.771505 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99ed45ca-919e-4812-8904-bcb2d4a05baf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:19.771953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99ed45ca-919e-4812-8904-bcb2d4a05baf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:19.772742 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99ed45ca-919e-4812-8904-bcb2d4a05baf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:19.773208 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-99ed45ca-919e-4812-8904-bcb2d4a05baf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:19.914038 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-99ed45ca-919e-4812-8904-bcb2d4a05baf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:19.922194 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-99ed45ca-919e-4812-8904-bcb2d4a05baf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.162555 Jul 12 07:15:19.922755 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 148/289] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:19 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:20.940146 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-67941be9-ecc5-4720-9d6d-532539e92dee tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:20.940853 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-67941be9-ecc5-4720-9d6d-532539e92dee tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:20.956079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67941be9-ecc5-4720-9d6d-532539e92dee tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:20.956522 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67941be9-ecc5-4720-9d6d-532539e92dee tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:20.957340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67941be9-ecc5-4720-9d6d-532539e92dee tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:20.957762 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67941be9-ecc5-4720-9d6d-532539e92dee tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:21.102368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-67941be9-ecc5-4720-9d6d-532539e92dee tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:21.111426 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-67941be9-ecc5-4720-9d6d-532539e92dee tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.175613 Jul 12 07:15:21.112008 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 142/290] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:20 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:21.158048 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1494645686", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-866755811", "security_groups": [{"name": "tempest-secgroup-smoke-2114819605"}], "networks": [{"uuid": "06a5b1f7-741c-4f60-9991-c510c0cbd028"}], "block_device_mapping_v2": [{"uuid": "d01d204b-1de4-404b-86af-a903d76ecc08", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:21.273336 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] validate_networks() for [('06a5b1f7-741c-4f60-9991-c510c0cbd028', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:15:21.375673 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fff62e3a-07c0-4217-875f-a1528d5c0ca6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:21.376294 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fff62e3a-07c0-4217-875f-a1528d5c0ca6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:21.378419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=28 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:21.385293 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fff62e3a-07c0-4217-875f-a1528d5c0ca6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:21.388725 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fff62e3a-07c0-4217-875f-a1528d5c0ca6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:21.389747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fff62e3a-07c0-4217-875f-a1528d5c0ca6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:21.390478 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fff62e3a-07c0-4217-875f-a1528d5c0ca6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:21.423617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fff62e3a-07c0-4217-875f-a1528d5c0ca6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/ips" status: 200 len: 146 microversion: 2.1 time: 0.051728 Jul 12 07:15:21.424410 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 143/291] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:15:21 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:15:21.694069 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:15:21.694547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:15:21.695093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:15:21.695547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:15:21.696025 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:15:21.710141 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:21.711201 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:21.714373 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:21.715011 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:21.732901 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Getting quotas for project 04a2e6cc3cbd4691a33722b5d058e82b. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:15:21.737439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Getting quotas for user 516ee78e2f9c43b195ad64b7a1d68624 and project 04a2e6cc3cbd4691a33722b5d058e82b. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:15:21.807977 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:15:21.810161 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d01d204b-1de4-404b-86af-a903d76ecc08',volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:15:21.813108 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-55193c30-7d28-46eb-ac31-22fada7e46dd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:21.814267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-55193c30-7d28-46eb-ac31-22fada7e46dd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:21.821305 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55193c30-7d28-46eb-ac31-22fada7e46dd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:21.821750 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55193c30-7d28-46eb-ac31-22fada7e46dd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:21.823318 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55193c30-7d28-46eb-ac31-22fada7e46dd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:21.823753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55193c30-7d28-46eb-ac31-22fada7e46dd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:21.855913 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-55193c30-7d28-46eb-ac31-22fada7e46dd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/ips" status: 200 len: 153 microversion: 2.20 time: 0.054462 Jul 12 07:15:21.857691 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 144/292] 10.222.0.25 () {60 vars in 1288 bytes} [Tue Jul 12 07:15:21 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/ips => generated 153 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 07:15:22.010953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-481f4a94-ecdf-4782-ac6f-84ce521697ed tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.856944 Jul 12 07:15:22.012646 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 149/293] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:15:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:15:22.023018 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb16cd8a-8f28-4b52-b4ff-f59a72538965 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:22.027755 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb16cd8a-8f28-4b52-b4ff-f59a72538965 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:22.100067 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bb16cd8a-8f28-4b52-b4ff-f59a72538965 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:22.110541 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb16cd8a-8f28-4b52-b4ff-f59a72538965 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1088 microversion: 2.1 time: 0.090125 Jul 12 07:15:22.117598 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 145/294] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:22 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1088 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:22.130027 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ec78c06d-e19b-4379-86a0-7b6fb5bc53f6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:22.130583 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ec78c06d-e19b-4379-86a0-7b6fb5bc53f6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:22.142522 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec78c06d-e19b-4379-86a0-7b6fb5bc53f6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:22.143196 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec78c06d-e19b-4379-86a0-7b6fb5bc53f6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:22.144365 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec78c06d-e19b-4379-86a0-7b6fb5bc53f6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:22.144980 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ec78c06d-e19b-4379-86a0-7b6fb5bc53f6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:22.374202 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ec78c06d-e19b-4379-86a0-7b6fb5bc53f6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:22.384186 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ec78c06d-e19b-4379-86a0-7b6fb5bc53f6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.259831 Jul 12 07:15:22.385159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 150/295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:22 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:23.133824 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6e85d568-f7c2-4f2d-9bb4-9f6bcbe181ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:23.135003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6e85d568-f7c2-4f2d-9bb4-9f6bcbe181ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:23.141189 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e85d568-f7c2-4f2d-9bb4-9f6bcbe181ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:23.141664 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e85d568-f7c2-4f2d-9bb4-9f6bcbe181ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:23.142415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e85d568-f7c2-4f2d-9bb4-9f6bcbe181ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:23.142841 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e85d568-f7c2-4f2d-9bb4-9f6bcbe181ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:23.208051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6e85d568-f7c2-4f2d-9bb4-9f6bcbe181ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:23.216159 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6e85d568-f7c2-4f2d-9bb4-9f6bcbe181ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1130 microversion: 2.1 time: 0.086414 Jul 12 07:15:23.216731 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 146/296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:23 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1130 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:23.401152 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-94786446-a6c3-4c53-9b99-835f5d699eea tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:23.401751 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-94786446-a6c3-4c53-9b99-835f5d699eea tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:23.409359 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-94786446-a6c3-4c53-9b99-835f5d699eea tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:23.409948 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-94786446-a6c3-4c53-9b99-835f5d699eea tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:23.410943 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-94786446-a6c3-4c53-9b99-835f5d699eea tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:23.411452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-94786446-a6c3-4c53-9b99-835f5d699eea tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:23.573764 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-94786446-a6c3-4c53-9b99-835f5d699eea tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:23.581387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-94786446-a6c3-4c53-9b99-835f5d699eea tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.184335 Jul 12 07:15:23.581925 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 151/297] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:23 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:23.967184 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a2427cd9-c2cf-4856-8bfb-c78d973cf04d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:23.967704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a2427cd9-c2cf-4856-8bfb-c78d973cf04d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:23.974055 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2427cd9-c2cf-4856-8bfb-c78d973cf04d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:23.974495 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2427cd9-c2cf-4856-8bfb-c78d973cf04d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:23.975608 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2427cd9-c2cf-4856-8bfb-c78d973cf04d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:23.976803 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2427cd9-c2cf-4856-8bfb-c78d973cf04d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:23.993803 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cf6a57c0-ec04-43fc-add2-a0b9e7aba22a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8924e168-0e72-4d92-b491-e9e1610316bb"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:23.995471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cf6a57c0-ec04-43fc-add2-a0b9e7aba22a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:24.007375 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf6a57c0-ec04-43fc-add2-a0b9e7aba22a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.008051 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf6a57c0-ec04-43fc-add2-a0b9e7aba22a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.008958 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf6a57c0-ec04-43fc-add2-a0b9e7aba22a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.009949 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf6a57c0-ec04-43fc-add2-a0b9e7aba22a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.019480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a2427cd9-c2cf-4856-8bfb-c78d973cf04d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/ips" status: 200 len: 150 microversion: 2.1 time: 0.057386 Jul 12 07:15:24.020066 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 147/298] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:15:23 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:24.061536 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-015a7407-a518-4dd6-9f69-22a95c0a7981 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:24.062442 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-015a7407-a518-4dd6-9f69-22a95c0a7981 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:24.070667 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-015a7407-a518-4dd6-9f69-22a95c0a7981 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.071265 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-015a7407-a518-4dd6-9f69-22a95c0a7981 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.072186 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-015a7407-a518-4dd6-9f69-22a95c0a7981 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.072741 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-015a7407-a518-4dd6-9f69-22a95c0a7981 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.101943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-015a7407-a518-4dd6-9f69-22a95c0a7981 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lazy-loading 'flavor' on Instance uuid e1dba59c-e816-486d-9296-9fcd6e5a51ff {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:15:24.430823 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-015a7407-a518-4dd6-9f69-22a95c0a7981 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/action" status: 202 len: 0 microversion: 2.20 time: 0.376882 Jul 12 07:15:24.437781 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 148/299] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 12 07:15:24 2022] POST /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 07:15:24.443577 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7c5a4277-77fc-40a1-9d95-4a65d978335d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:24.444206 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7c5a4277-77fc-40a1-9d95-4a65d978335d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:24.451345 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c5a4277-77fc-40a1-9d95-4a65d978335d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.451786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c5a4277-77fc-40a1-9d95-4a65d978335d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.452581 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c5a4277-77fc-40a1-9d95-4a65d978335d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.453005 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c5a4277-77fc-40a1-9d95-4a65d978335d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.521413 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7c5a4277-77fc-40a1-9d95-4a65d978335d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:24.529800 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7c5a4277-77fc-40a1-9d95-4a65d978335d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1186 microversion: 2.1 time: 0.090448 Jul 12 07:15:24.530424 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 149/300] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:24 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:24.535146 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:24.535740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:24.542666 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.543088 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.543851 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.544280 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.686666 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:24.696188 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:24.697736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:24.698900 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5f5dc5c4-30fb-4e72-a81c-c3e2d4be80d0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.167294 Jul 12 07:15:24.699452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 150/301] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:24 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:24.704252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-52238c13-ffee-452c-afb6-452fd8f2656b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:24.704857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-52238c13-ffee-452c-afb6-452fd8f2656b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:24.711127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52238c13-ffee-452c-afb6-452fd8f2656b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.711710 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52238c13-ffee-452c-afb6-452fd8f2656b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.712533 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52238c13-ffee-452c-afb6-452fd8f2656b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:24.712984 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52238c13-ffee-452c-afb6-452fd8f2656b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:24.907097 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cf6a57c0-ec04-43fc-add2-a0b9e7aba22a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.919320 Jul 12 07:15:24.908028 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 152/302] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:15:23 2022] POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:24.954066 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-52238c13-ffee-452c-afb6-452fd8f2656b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:24.965963 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-52238c13-ffee-452c-afb6-452fd8f2656b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.265196 Jul 12 07:15:24.966628 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 151/303] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:24 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:25.418933 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-39f9b7cc-7b8e-4da5-aa97-ef940e0f755d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "243b2933-867d-4d16-a908-157f079ab1ff"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:25.420098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-39f9b7cc-7b8e-4da5-aa97-ef940e0f755d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:25.426862 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39f9b7cc-7b8e-4da5-aa97-ef940e0f755d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:25.427300 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39f9b7cc-7b8e-4da5-aa97-ef940e0f755d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:25.428054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39f9b7cc-7b8e-4da5-aa97-ef940e0f755d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:25.428480 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-39f9b7cc-7b8e-4da5-aa97-ef940e0f755d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:25.546530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ebbcc7e4-70e6-4373-93d2-abbd68729d14 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:25.547069 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ebbcc7e4-70e6-4373-93d2-abbd68729d14 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:25.553546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebbcc7e4-70e6-4373-93d2-abbd68729d14 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:25.553980 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebbcc7e4-70e6-4373-93d2-abbd68729d14 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:25.554720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebbcc7e4-70e6-4373-93d2-abbd68729d14 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:25.555139 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebbcc7e4-70e6-4373-93d2-abbd68729d14 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:25.641947 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ebbcc7e4-70e6-4373-93d2-abbd68729d14 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:25.652243 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ebbcc7e4-70e6-4373-93d2-abbd68729d14 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1204 microversion: 2.1 time: 0.109769 Jul 12 07:15:25.652824 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 152/304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:25 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1204 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:25.718046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:25.718637 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:25.724946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:25.725404 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:25.726212 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:25.726630 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:25.950692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:25.963293 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:25.964870 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:25.966031 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-524c772d-d3c2-49bc-8df7-2f231050392b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.251996 Jul 12 07:15:25.967170 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 153/305] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:25 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:15:25.984627 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-872229cf-670e-4fce-abbd-839248e3765a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:25.985340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-872229cf-670e-4fce-abbd-839248e3765a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:25.995894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-872229cf-670e-4fce-abbd-839248e3765a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:25.995894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-872229cf-670e-4fce-abbd-839248e3765a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:25.996590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-872229cf-670e-4fce-abbd-839248e3765a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:25.997217 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-872229cf-670e-4fce-abbd-839248e3765a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:26.301135 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-872229cf-670e-4fce-abbd-839248e3765a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:26.310081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-872229cf-670e-4fce-abbd-839248e3765a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1503 microversion: 2.1 time: 0.329502 Jul 12 07:15:26.311052 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 154/306] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:25 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:26.327336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67a58e6f-c198-464b-a7e4-3b8ebe0d0f5c"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:26.328455 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:26.334555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:26.335227 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:26.336133 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:26.336713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:26.361368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] HTTP exception thrown: Cannot 'attach_volume' instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 while it is in vm_state rescued Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Request method failure captured: Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: POST /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89/os-volume_attachments HTTP/1.1 Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 74 Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8LNzVtfwpWAvhiG2VP0p95W_cw9L67Ras80UJ2NEefm-WsWmJD5azfokIEUQefIyUkbJ_7V7fsLEiDZGmTCEF0IneZIGogc__7IY7HGtn2qzESHPoii1lhONc87MT1rgwRsXngi2y59qxPUzaz-EkboDdqOQsCgr6lARNC3J29QuM Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:15:26.363279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02510f7812444c59bec582ff1127aa13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02510f7812444c59bec582ff1127aa13"}]}] Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 7093cc7cf9d1472db33b31e5f98a5141 Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {"volumeAttachment": {"volumeId": "67a58e6f-c198-464b-a7e4-3b8ebe0d0f5c"}} Jul 12 07:15:26.364819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Cannot 'attach_volume' instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 while it is in vm_state rescued Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'server_id': '2eae86e1-220e-41f6-9b8d-7b5a224f7a89', 'body': {'volumeAttachment': {'volumeId': '67a58e6f-c198-464b-a7e4-3b8ebe0d0f5c'}}} Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:15:26.366176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 while it is in vm_state rescued Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:15:26.367514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:15:26.369036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:15:26.369036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:15:26.369036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 while it is in vm_state rescued Jul 12 07:15:26.369036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:15:26.369036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Returning 409 to user: Cannot 'attach_volume' instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 while it is in vm_state rescued {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:15:26.369036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5cf61867-9146-4b0c-a214-8907ebe2e7b8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041551 Jul 12 07:15:26.369036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 155/307] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:15:26 2022] POST /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 12 07:15:26.374863 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b4a2c08f-3108-4cb1-a8a5-3a3026c7bb4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:26.374863 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b4a2c08f-3108-4cb1-a8a5-3a3026c7bb4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:26.380808 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4a2c08f-3108-4cb1-a8a5-3a3026c7bb4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:26.381500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4a2c08f-3108-4cb1-a8a5-3a3026c7bb4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:26.382353 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4a2c08f-3108-4cb1-a8a5-3a3026c7bb4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:26.382665 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4a2c08f-3108-4cb1-a8a5-3a3026c7bb4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:26.426820 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:26.468551 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b4a2c08f-3108-4cb1-a8a5-3a3026c7bb4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89/action" status: 202 len: 0 microversion: 2.1 time: 0.098244 Jul 12 07:15:26.472886 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 156/308] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:15:26 2022] POST /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:15:26.490215 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c5a01534-bb18-4183-b0e4-b41f51189e8d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:26.491272 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c5a01534-bb18-4183-b0e4-b41f51189e8d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:26.498672 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5a01534-bb18-4183-b0e4-b41f51189e8d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:26.500784 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5a01534-bb18-4183-b0e4-b41f51189e8d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:26.501796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5a01534-bb18-4183-b0e4-b41f51189e8d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:26.502219 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5a01534-bb18-4183-b0e4-b41f51189e8d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:26.558121 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-39f9b7cc-7b8e-4da5-aa97-ef940e0f755d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.143775 Jul 12 07:15:26.559502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 153/309] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:15:25 2022] POST /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-volume_attachments => generated 194 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:26.673197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ea0157f4-8b47-46c5-b7d1-3795cd1a5dd3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:26.677837 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ea0157f4-8b47-46c5-b7d1-3795cd1a5dd3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:26.686112 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea0157f4-8b47-46c5-b7d1-3795cd1a5dd3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:26.686558 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea0157f4-8b47-46c5-b7d1-3795cd1a5dd3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:26.687327 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea0157f4-8b47-46c5-b7d1-3795cd1a5dd3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:26.687811 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ea0157f4-8b47-46c5-b7d1-3795cd1a5dd3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:27.188409 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c5a01534-bb18-4183-b0e4-b41f51189e8d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:27.196974 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c5a01534-bb18-4183-b0e4-b41f51189e8d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1511 microversion: 2.1 time: 0.712009 Jul 12 07:15:27.197502 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 157/310] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:26 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1511 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:27.202226 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:27.202813 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:27.209195 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:27.209651 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:27.210397 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:27.210821 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:27.233748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ea0157f4-8b47-46c5-b7d1-3795cd1a5dd3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:27.235885 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:27.245836 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ea0157f4-8b47-46c5-b7d1-3795cd1a5dd3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1272 microversion: 2.1 time: 0.579227 Jul 12 07:15:27.247047 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 154/311] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:26 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1272 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:27.613396 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:27.622167 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:27.623680 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:27.624831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d5486b1-8f2a-480b-98ff-4611afdfa8a2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.426294 Jul 12 07:15:27.627572 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 158/312] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:27 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:28.026485 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-ede866c7-bc4f-4cd8-9750-10f8aec8f4b0 req-478c788c-dfb9-43da-87d7-5af850548926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7ccb04-eb99-4561-9c24-4480c4e0422e", "tag": "696d296b-c149-42d6-896a-50d0d9cc8ad8"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:28.037286 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ede866c7-bc4f-4cd8-9750-10f8aec8f4b0 req-478c788c-dfb9-43da-87d7-5af850548926 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:28.037962 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ede866c7-bc4f-4cd8-9750-10f8aec8f4b0 req-478c788c-dfb9-43da-87d7-5af850548926 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:28.052092 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-ede866c7-bc4f-4cd8-9750-10f8aec8f4b0 req-478c788c-dfb9-43da-87d7-5af850548926 service nova] Creating event network-changed:696d296b-c149-42d6-896a-50d0d9cc8ad8 for instance cf7ccb04-eb99-4561-9c24-4480c4e0422e on hv-cinder-82549 Jul 12 07:15:28.057961 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-ede866c7-bc4f-4cd8-9750-10f8aec8f4b0 req-478c788c-dfb9-43da-87d7-5af850548926 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035615 Jul 12 07:15:28.059174 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 155/313] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:28.215272 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-90054b14-d360-43cb-b753-fd829354f804 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:28.216012 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-90054b14-d360-43cb-b753-fd829354f804 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:28.228028 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90054b14-d360-43cb-b753-fd829354f804 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:28.228516 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90054b14-d360-43cb-b753-fd829354f804 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:28.231407 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90054b14-d360-43cb-b753-fd829354f804 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:28.231887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90054b14-d360-43cb-b753-fd829354f804 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:28.263484 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-53efd6a6-6770-4db7-a7fa-aca9dc3cc850 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:28.264149 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-53efd6a6-6770-4db7-a7fa-aca9dc3cc850 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:28.270821 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-53efd6a6-6770-4db7-a7fa-aca9dc3cc850 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:28.271263 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-53efd6a6-6770-4db7-a7fa-aca9dc3cc850 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:28.272021 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-53efd6a6-6770-4db7-a7fa-aca9dc3cc850 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:28.272452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-53efd6a6-6770-4db7-a7fa-aca9dc3cc850 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:28.435797 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-90054b14-d360-43cb-b753-fd829354f804 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:28.443525 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-90054b14-d360-43cb-b753-fd829354f804 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1511 microversion: 2.1 time: 0.233152 Jul 12 07:15:28.444077 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 159/314] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:28 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:28.463229 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-53efd6a6-6770-4db7-a7fa-aca9dc3cc850 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:28.472141 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-53efd6a6-6770-4db7-a7fa-aca9dc3cc850 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1260 microversion: 2.1 time: 0.213022 Jul 12 07:15:28.472711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 156/315] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:28 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:28.643949 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:28.644554 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:28.651070 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:28.651516 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:28.652289 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:28.652718 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:28.936618 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:28.946128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:28.947997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:28.949204 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b87af1b6-2578-49eb-be80-0adb378b5700 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.309245 Jul 12 07:15:28.949783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 160/316] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:28 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:29.461267 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-51c955d3-0f69-4e68-95c6-c8b31e60af84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:29.462601 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-51c955d3-0f69-4e68-95c6-c8b31e60af84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:29.469593 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-51c955d3-0f69-4e68-95c6-c8b31e60af84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:29.470055 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-51c955d3-0f69-4e68-95c6-c8b31e60af84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:29.470824 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-51c955d3-0f69-4e68-95c6-c8b31e60af84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:29.471417 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-51c955d3-0f69-4e68-95c6-c8b31e60af84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:29.492074 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2066d342-b8c3-48c4-8b62-a97f2f318336 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:29.493328 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2066d342-b8c3-48c4-8b62-a97f2f318336 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:29.499504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2066d342-b8c3-48c4-8b62-a97f2f318336 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:29.499931 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2066d342-b8c3-48c4-8b62-a97f2f318336 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:29.500998 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2066d342-b8c3-48c4-8b62-a97f2f318336 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:29.501599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2066d342-b8c3-48c4-8b62-a97f2f318336 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:29.760089 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-51c955d3-0f69-4e68-95c6-c8b31e60af84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:29.768096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-51c955d3-0f69-4e68-95c6-c8b31e60af84 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1511 microversion: 2.1 time: 0.310867 Jul 12 07:15:29.770638 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2066d342-b8c3-48c4-8b62-a97f2f318336 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:29.778421 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 157/317] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:29 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:29.781508 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2066d342-b8c3-48c4-8b62-a97f2f318336 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1260 microversion: 2.1 time: 0.295564 Jul 12 07:15:29.782070 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 161/318] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:29 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:29.968790 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:29.969498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:29.981110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:29.981110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:29.981110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:29.981110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:30.128745 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:30.146412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:30.148125 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:30.149371 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e323cc53-ee1c-4b3f-b9e1-d1f7b8823237 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.185252 Jul 12 07:15:30.149922 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 158/319] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:29 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:30.785827 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-66e62389-aca0-47a1-886f-6e4ffa8f56a1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:30.787226 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-66e62389-aca0-47a1-886f-6e4ffa8f56a1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:30.796584 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66e62389-aca0-47a1-886f-6e4ffa8f56a1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:30.797021 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66e62389-aca0-47a1-886f-6e4ffa8f56a1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:30.797998 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66e62389-aca0-47a1-886f-6e4ffa8f56a1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:30.798211 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-67288567-3a0e-477e-a18d-84c2169c851c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:30.798700 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66e62389-aca0-47a1-886f-6e4ffa8f56a1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:30.799498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-67288567-3a0e-477e-a18d-84c2169c851c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:30.806125 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67288567-3a0e-477e-a18d-84c2169c851c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:30.806536 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67288567-3a0e-477e-a18d-84c2169c851c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:30.808486 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67288567-3a0e-477e-a18d-84c2169c851c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:30.808926 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67288567-3a0e-477e-a18d-84c2169c851c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:31.036078 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-67288567-3a0e-477e-a18d-84c2169c851c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:31.039043 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-66e62389-aca0-47a1-886f-6e4ffa8f56a1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:31.044429 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-67288567-3a0e-477e-a18d-84c2169c851c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1260 microversion: 2.1 time: 0.249973 Jul 12 07:15:31.045208 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 159/320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:30 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:31.047101 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-66e62389-aca0-47a1-886f-6e4ffa8f56a1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1517 microversion: 2.1 time: 0.265201 Jul 12 07:15:31.047647 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 162/321] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:30 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:31.169277 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:31.170288 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:31.180870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:31.181802 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:31.183121 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:31.183733 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:31.539563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:31.549260 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:31.551155 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:31.552327 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ba805c21-9655-4e18-86ea-a904b1524317 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.388312 Jul 12 07:15:31.553540 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 160/322] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:31 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:31.676104 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1f4b3617-e950-4356-a4c9-280b5fd94316 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:31.685829 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f4b3617-e950-4356-a4c9-280b5fd94316 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:31.686527 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f4b3617-e950-4356-a4c9-280b5fd94316 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:31.748473 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1f4b3617-e950-4356-a4c9-280b5fd94316 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Going to try to stop instance {{(pid=117997) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 07:15:31.793028 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1f4b3617-e950-4356-a4c9-280b5fd94316 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/action" status: 202 len: 0 microversion: 2.1 time: 0.122229 Jul 12 07:15:31.793806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 163/323] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:15:31 2022] POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:15:31.801847 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7349e3b9-7f31-455a-8c99-c84313bd152e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:31.802454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7349e3b9-7f31-455a-8c99-c84313bd152e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:31.804429 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:31.805089 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:31.811809 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7349e3b9-7f31-455a-8c99-c84313bd152e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:31.812270 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7349e3b9-7f31-455a-8c99-c84313bd152e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:31.813015 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7349e3b9-7f31-455a-8c99-c84313bd152e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:31.813518 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7349e3b9-7f31-455a-8c99-c84313bd152e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:31.963684 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7349e3b9-7f31-455a-8c99-c84313bd152e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:31.971913 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7349e3b9-7f31-455a-8c99-c84313bd152e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.173941 Jul 12 07:15:31.972488 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 161/324] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:31 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:32.064707 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-de44768c-43f4-411e-a93c-ca7f4139e708 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:32.065724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-de44768c-43f4-411e-a93c-ca7f4139e708 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:32.075198 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de44768c-43f4-411e-a93c-ca7f4139e708 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:32.075822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de44768c-43f4-411e-a93c-ca7f4139e708 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:32.076877 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de44768c-43f4-411e-a93c-ca7f4139e708 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:32.077527 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de44768c-43f4-411e-a93c-ca7f4139e708 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:32.107911 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:32.223249 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-de44768c-43f4-411e-a93c-ca7f4139e708 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:32.231116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-de44768c-43f4-411e-a93c-ca7f4139e708 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1260 microversion: 2.1 time: 0.172435 Jul 12 07:15:32.231723 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 164/325] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:32 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:32.487436 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-98c0ed66-b790-4e2b-b384-31bc938ecc99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'create', calling method: .version_select at 0x7f7011b36820>, body: {"keypair": {"name": "tempest-keypair-1599832667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOL8GCntrPjFkgjsH6YZfWMlPJKBrMPqhkDEpFDFCGN4Gu+itOFYNV7Obm84Xlg5Pnp+50xRroN5EmyYL/NhRfW5t9OFz3SKoUqGYF870ZIioBBsbK3m6AE9cWcXnL/RA=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:32.502326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-98c0ed66-b790-4e2b-b384-31bc938ecc99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Getting quotas for project 02510f7812444c59bec582ff1127aa13. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:15:32.506158 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-98c0ed66-b790-4e2b-b384-31bc938ecc99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Getting quotas for user 7093cc7cf9d1472db33b31e5f98a5141 and project 02510f7812444c59bec582ff1127aa13. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:15:32.533206 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-98c0ed66-b790-4e2b-b384-31bc938ecc99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049519 Jul 12 07:15:32.533987 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 162/326] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:15:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:32.571015 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:32.571613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:32.577719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:32.578157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:32.578950 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:32.579340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:32.784997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:32.795807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:32.797349 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:32.798549 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7f265b5e-7cbc-4dc8-9d37-fd6e267e4647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.231511 Jul 12 07:15:32.799096 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 165/327] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:32 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:32.990616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fa0ef938-c52e-407d-aadc-301bd716605f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:32.992305 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fa0ef938-c52e-407d-aadc-301bd716605f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:33.010248 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fa0ef938-c52e-407d-aadc-301bd716605f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:33.011287 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fa0ef938-c52e-407d-aadc-301bd716605f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:33.012339 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fa0ef938-c52e-407d-aadc-301bd716605f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:33.012996 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fa0ef938-c52e-407d-aadc-301bd716605f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:33.151543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fa0ef938-c52e-407d-aadc-301bd716605f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:33.160129 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fa0ef938-c52e-407d-aadc-301bd716605f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.174282 Jul 12 07:15:33.160702 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 163/328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:32 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:33.248811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f9daa0b1-6a48-497c-804f-0241f5025510 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:33.249449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f9daa0b1-6a48-497c-804f-0241f5025510 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:33.257664 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9daa0b1-6a48-497c-804f-0241f5025510 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:33.258427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9daa0b1-6a48-497c-804f-0241f5025510 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:33.259157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9daa0b1-6a48-497c-804f-0241f5025510 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:33.259741 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9daa0b1-6a48-497c-804f-0241f5025510 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:33.490714 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f9daa0b1-6a48-497c-804f-0241f5025510 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:33.501873 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f9daa0b1-6a48-497c-804f-0241f5025510 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1260 microversion: 2.1 time: 0.257739 Jul 12 07:15:33.502459 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 166/329] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:33 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:33.816966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:33.817618 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:33.824126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:33.824559 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:33.825350 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:33.825884 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:34.169394 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:34.178932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a0c14f78-4e6e-4833-ad13-6a5f4278dcff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:34.180213 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a0c14f78-4e6e-4833-ad13-6a5f4278dcff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:34.184814 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:34.187160 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:34.188866 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-88a01f06-8c8d-4ec8-af23-3cdd873f49e1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.376058 Jul 12 07:15:34.189961 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 164/330] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:33 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:34.195638 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0c14f78-4e6e-4833-ad13-6a5f4278dcff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:34.196083 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0c14f78-4e6e-4833-ad13-6a5f4278dcff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:34.196887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0c14f78-4e6e-4833-ad13-6a5f4278dcff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:34.197806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0c14f78-4e6e-4833-ad13-6a5f4278dcff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:34.322312 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-772730823", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ea7e59d-da2f-4f32-87f4-8db38c9ed917"}], "security_groups": [{"name": "tempest-securitygroup--1001453576"}], "key_name": "tempest-keypair-1599832667", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:34.359096 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a0c14f78-4e6e-4833-ad13-6a5f4278dcff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:34.384463 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a0c14f78-4e6e-4833-ad13-6a5f4278dcff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.209661 Jul 12 07:15:34.396271 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 167/331] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:34 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:34.441388 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] validate_networks() for [('7ea7e59d-da2f-4f32-87f4-8db38c9ed917', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:15:34.522758 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a747476-4773-4045-9d87-80f7656433e2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:34.523598 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a747476-4773-4045-9d87-80f7656433e2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:34.531160 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a747476-4773-4045-9d87-80f7656433e2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:34.531859 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a747476-4773-4045-9d87-80f7656433e2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:34.532734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a747476-4773-4045-9d87-80f7656433e2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:34.533240 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a747476-4773-4045-9d87-80f7656433e2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:34.964881 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9a747476-4773-4045-9d87-80f7656433e2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:34.973076 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a747476-4773-4045-9d87-80f7656433e2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1260 microversion: 2.1 time: 0.456806 Jul 12 07:15:34.973642 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 168/332] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:34 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1260 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:35.129262 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:15:35.129701 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:15:35.130417 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:15:35.130877 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:15:35.131406 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:15:35.141911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:35.142688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:35.143699 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:35.144548 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:35.164026 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Getting quotas for project 02510f7812444c59bec582ff1127aa13. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:15:35.168759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Getting quotas for user 7093cc7cf9d1472db33b31e5f98a5141 and project 02510f7812444c59bec582ff1127aa13. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:15:35.181280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:15:35.183916 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:15:35.208968 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:35.209609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:35.216567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:35.216999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:35.217878 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:35.218363 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:35.231393 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-19c62144-a9b2-4c23-9dce-1b248f85feef tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.912931 Jul 12 07:15:35.236846 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 165/333] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:15:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 07:15:35.241758 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-00d3c93f-7467-4427-9321-0a676dc40952 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:35.242447 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-00d3c93f-7467-4427-9321-0a676dc40952 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:35.344724 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-00d3c93f-7467-4427-9321-0a676dc40952 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:35.352144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-00d3c93f-7467-4427-9321-0a676dc40952 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1245 microversion: 2.1 time: 0.114132 Jul 12 07:15:35.352947 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 166/334] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:35 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:35.395565 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:35.404195 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8e22121f-b6cd-4e4a-8426-bb41fd88a9e2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:35.404439 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:35.405245 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8e22121f-b6cd-4e4a-8426-bb41fd88a9e2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:35.406036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:35.407642 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-db4e5f6e-dd87-4b38-8f32-9ddf4b35d01e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.202970 Jul 12 07:15:35.408621 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 169/335] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:35 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:35.426370 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8e22121f-b6cd-4e4a-8426-bb41fd88a9e2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:35.427080 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8e22121f-b6cd-4e4a-8426-bb41fd88a9e2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:35.427843 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8e22121f-b6cd-4e4a-8426-bb41fd88a9e2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:35.428479 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8e22121f-b6cd-4e4a-8426-bb41fd88a9e2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:35.468812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-99c823be-5dbf-48b1-a3ba-539b0d809e23 req-87f50a33-68f6-4eb3-914e-f62f5e4551f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7ccb04-eb99-4561-9c24-4480c4e0422e", "name": "network-vif-plugged", "status": "completed", "tag": "696d296b-c149-42d6-896a-50d0d9cc8ad8"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:35.481282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-99c823be-5dbf-48b1-a3ba-539b0d809e23 req-87f50a33-68f6-4eb3-914e-f62f5e4551f4 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:35.481806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-99c823be-5dbf-48b1-a3ba-539b0d809e23 req-87f50a33-68f6-4eb3-914e-f62f5e4551f4 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:35.507633 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-99c823be-5dbf-48b1-a3ba-539b0d809e23 req-87f50a33-68f6-4eb3-914e-f62f5e4551f4 service nova] Creating event network-vif-plugged:696d296b-c149-42d6-896a-50d0d9cc8ad8 for instance cf7ccb04-eb99-4561-9c24-4480c4e0422e on hv-cinder-82549 Jul 12 07:15:35.513943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-99c823be-5dbf-48b1-a3ba-539b0d809e23 req-87f50a33-68f6-4eb3-914e-f62f5e4551f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049883 Jul 12 07:15:35.515069 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 170/336] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:15:35.636076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8e22121f-b6cd-4e4a-8426-bb41fd88a9e2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:35.652777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8e22121f-b6cd-4e4a-8426-bb41fd88a9e2 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.252657 Jul 12 07:15:35.653718 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 167/337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:35 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:35.991876 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f47e6c2d-c754-49e6-a0ab-687502d702ba tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:35.992817 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f47e6c2d-c754-49e6-a0ab-687502d702ba tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:36.002739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f47e6c2d-c754-49e6-a0ab-687502d702ba tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:36.003170 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f47e6c2d-c754-49e6-a0ab-687502d702ba tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:36.004197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f47e6c2d-c754-49e6-a0ab-687502d702ba tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:36.004687 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f47e6c2d-c754-49e6-a0ab-687502d702ba tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:36.152557 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f47e6c2d-c754-49e6-a0ab-687502d702ba tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:36.160380 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f47e6c2d-c754-49e6-a0ab-687502d702ba tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1260 microversion: 2.1 time: 0.173086 Jul 12 07:15:36.160947 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 171/338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:35 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:36.373230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-107d2c56-1bb8-40ab-a372-2082b9f32af1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:36.373976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-107d2c56-1bb8-40ab-a372-2082b9f32af1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:36.380956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-107d2c56-1bb8-40ab-a372-2082b9f32af1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:36.381472 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-107d2c56-1bb8-40ab-a372-2082b9f32af1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:36.382225 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-107d2c56-1bb8-40ab-a372-2082b9f32af1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:36.382840 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-107d2c56-1bb8-40ab-a372-2082b9f32af1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:36.427945 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:36.428547 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:36.435738 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:36.436189 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:36.437164 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:36.437597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:36.447602 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-107d2c56-1bb8-40ab-a372-2082b9f32af1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:36.455274 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-107d2c56-1bb8-40ab-a372-2082b9f32af1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1297 microversion: 2.1 time: 0.088551 Jul 12 07:15:36.455846 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 168/339] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:36 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:36.456068 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:36.580098 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:36.588622 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:36.590315 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:36.591446 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e038d066-f94c-4927-be99-642987a05869 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.167637 Jul 12 07:15:36.592004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 172/340] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:36 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:15:36.669909 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-86b1b47f-70bb-42a8-bfe3-7dcb600f1d7f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:36.670503 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-86b1b47f-70bb-42a8-bfe3-7dcb600f1d7f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:36.672368 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:36.677592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-86b1b47f-70bb-42a8-bfe3-7dcb600f1d7f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:36.678093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-86b1b47f-70bb-42a8-bfe3-7dcb600f1d7f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:36.678779 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-86b1b47f-70bb-42a8-bfe3-7dcb600f1d7f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:36.679202 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-86b1b47f-70bb-42a8-bfe3-7dcb600f1d7f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:36.813671 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-86b1b47f-70bb-42a8-bfe3-7dcb600f1d7f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:36.823485 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-86b1b47f-70bb-42a8-bfe3-7dcb600f1d7f tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.157850 Jul 12 07:15:36.824430 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 169/341] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:36 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:37.178003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-589f117d-08ec-40c0-9a7c-3e40ec6ea5bb tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:37.178883 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-589f117d-08ec-40c0-9a7c-3e40ec6ea5bb tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:37.186695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-589f117d-08ec-40c0-9a7c-3e40ec6ea5bb tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:37.187137 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-589f117d-08ec-40c0-9a7c-3e40ec6ea5bb tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:37.187887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-589f117d-08ec-40c0-9a7c-3e40ec6ea5bb tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:37.188307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-589f117d-08ec-40c0-9a7c-3e40ec6ea5bb tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:37.384586 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-589f117d-08ec-40c0-9a7c-3e40ec6ea5bb tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:37.393090 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-589f117d-08ec-40c0-9a7c-3e40ec6ea5bb tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1260 microversion: 2.1 time: 0.219026 Jul 12 07:15:37.393977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 173/342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:37 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:37.474285 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f4249a80-ddff-45e8-ae9f-729239a11fbc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:37.475474 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f4249a80-ddff-45e8-ae9f-729239a11fbc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:37.483452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4249a80-ddff-45e8-ae9f-729239a11fbc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:37.484152 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4249a80-ddff-45e8-ae9f-729239a11fbc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:37.485083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4249a80-ddff-45e8-ae9f-729239a11fbc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:37.485766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4249a80-ddff-45e8-ae9f-729239a11fbc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:37.580922 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f4249a80-ddff-45e8-ae9f-729239a11fbc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:37.596459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f4249a80-ddff-45e8-ae9f-729239a11fbc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1297 microversion: 2.1 time: 0.125842 Jul 12 07:15:37.597698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 170/343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:37 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1297 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:37.609603 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:37.611015 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:37.617570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:37.618103 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:37.618884 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:37.619309 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:37.841019 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-42cc1732-b243-4b36-83a8-0e4b2ac5829b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:37.841661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-42cc1732-b243-4b36-83a8-0e4b2ac5829b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:37.848018 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-42cc1732-b243-4b36-83a8-0e4b2ac5829b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:37.848461 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-42cc1732-b243-4b36-83a8-0e4b2ac5829b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:37.849244 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-42cc1732-b243-4b36-83a8-0e4b2ac5829b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:37.849720 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-42cc1732-b243-4b36-83a8-0e4b2ac5829b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:37.955599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:37.963998 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:37.965587 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:37.966753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7fbb8862-3a11-491f-b733-4b819e534a9a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.361349 Jul 12 07:15:37.977137 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 174/344] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:37 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:38.102952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-42cc1732-b243-4b36-83a8-0e4b2ac5829b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:38.115324 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-42cc1732-b243-4b36-83a8-0e4b2ac5829b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.278152 Jul 12 07:15:38.116281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 171/345] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:37 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:38.410216 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-500c9248-eb47-41c2-bfe2-627687926a1f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:38.410912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-500c9248-eb47-41c2-bfe2-627687926a1f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:38.418203 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-500c9248-eb47-41c2-bfe2-627687926a1f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:38.418830 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-500c9248-eb47-41c2-bfe2-627687926a1f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:38.419693 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-500c9248-eb47-41c2-bfe2-627687926a1f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:38.420186 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-500c9248-eb47-41c2-bfe2-627687926a1f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:38.615397 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-06160825-d96a-435a-89a6-1d8c2af952ab tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:38.615984 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-06160825-d96a-435a-89a6-1d8c2af952ab tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:38.630829 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06160825-d96a-435a-89a6-1d8c2af952ab tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:38.631269 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06160825-d96a-435a-89a6-1d8c2af952ab tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:38.632034 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06160825-d96a-435a-89a6-1d8c2af952ab tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:38.632443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06160825-d96a-435a-89a6-1d8c2af952ab tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:38.674959 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-500c9248-eb47-41c2-bfe2-627687926a1f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:38.683201 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-500c9248-eb47-41c2-bfe2-627687926a1f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1444 microversion: 2.1 time: 0.276895 Jul 12 07:15:38.684071 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 175/346] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:38 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1444 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:38.700168 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-32b96999-ab66-48df-ad2e-d4b2adc34a89 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:38.700761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-32b96999-ab66-48df-ad2e-d4b2adc34a89 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:38.708235 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32b96999-ab66-48df-ad2e-d4b2adc34a89 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:38.708679 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32b96999-ab66-48df-ad2e-d4b2adc34a89 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:38.709828 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32b96999-ab66-48df-ad2e-d4b2adc34a89 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:38.710243 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32b96999-ab66-48df-ad2e-d4b2adc34a89 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:38.766235 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-06160825-d96a-435a-89a6-1d8c2af952ab tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:38.775976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-06160825-d96a-435a-89a6-1d8c2af952ab tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1305 microversion: 2.1 time: 0.164984 Jul 12 07:15:38.776872 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 172/347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:38 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1305 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:38.945842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-32b96999-ab66-48df-ad2e-d4b2adc34a89 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:38.953724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-32b96999-ab66-48df-ad2e-d4b2adc34a89 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1444 microversion: 2.1 time: 0.257363 Jul 12 07:15:38.954441 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 176/348] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:38 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1444 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:38.993888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:39.001197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:39.008685 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:39.009146 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:39.009910 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:39.010338 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:39.132956 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b21d4b1-82b4-450d-930c-f158e684b657 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:39.133502 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0b21d4b1-82b4-450d-930c-f158e684b657 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:39.140449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b21d4b1-82b4-450d-930c-f158e684b657 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:39.141043 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b21d4b1-82b4-450d-930c-f158e684b657 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:39.142076 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b21d4b1-82b4-450d-930c-f158e684b657 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:39.142600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b21d4b1-82b4-450d-930c-f158e684b657 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:39.166586 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:39.175766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:39.177382 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:39.178652 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9c095d8d-4059-410f-a2af-6770f191dc90 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.196368 Jul 12 07:15:39.179281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 173/349] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:38 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:39.421853 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0b21d4b1-82b4-450d-930c-f158e684b657 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:39.430321 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0b21d4b1-82b4-450d-930c-f158e684b657 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.301422 Jul 12 07:15:39.441715 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 177/350] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:39 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:39.797111 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d4247e55-3be7-4923-a825-3a4c7b77c18b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:39.797919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d4247e55-3be7-4923-a825-3a4c7b77c18b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:39.814413 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4247e55-3be7-4923-a825-3a4c7b77c18b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:39.815477 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4247e55-3be7-4923-a825-3a4c7b77c18b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:39.816395 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4247e55-3be7-4923-a825-3a4c7b77c18b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:39.822823 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d4247e55-3be7-4923-a825-3a4c7b77c18b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:39.948655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d4247e55-3be7-4923-a825-3a4c7b77c18b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:39.955511 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:39.958418 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d4247e55-3be7-4923-a825-3a4c7b77c18b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1303 microversion: 2.1 time: 0.168086 Jul 12 07:15:39.959191 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 174/351] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:39 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:40.197311 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:40.197919 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:40.205501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:40.205966 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:40.207110 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:40.207670 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:40.448609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-eb559b38-b545-43bb-bef4-dce007d4133c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:40.449342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-eb559b38-b545-43bb-bef4-dce007d4133c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:40.457556 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb559b38-b545-43bb-bef4-dce007d4133c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:40.458200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb559b38-b545-43bb-bef4-dce007d4133c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:40.459263 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb559b38-b545-43bb-bef4-dce007d4133c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:40.459915 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb559b38-b545-43bb-bef4-dce007d4133c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:40.827661 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:40.836378 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:40.838117 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:40.839335 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d315491-7d08-4411-a7e4-7fcd94c3d7f5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.646585 Jul 12 07:15:40.840065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 178/352] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:40 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:40.853132 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-00db472c-63f4-4a28-bdf4-e77606b34d29 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: .version_select at 0x7f70118e11f0>, body: {"keypair": {"name": "tempest-keypair-574247068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ13H4WcE9T69X+L1tmABpKVNdh/2+5iRsN8idr1i2CCBdk40AtHhwPHswQ8EbcYMB3yaNAsJcMOe7qVupdpaNOtm81hIiA9DC07r4JtkzTI9ZVd6cKeZaJN0SWUAGS37A=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:40.858444 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-eb559b38-b545-43bb-bef4-dce007d4133c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:40.869623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-eb559b38-b545-43bb-bef4-dce007d4133c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.424105 Jul 12 07:15:40.880985 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 175/353] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:40 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:40.886026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-00db472c-63f4-4a28-bdf4-e77606b34d29 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for project b52e5f4c43a3469db851b4704f422448. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:15:40.904006 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-00db472c-63f4-4a28-bdf4-e77606b34d29 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for user ef6395fa14b54c43931ffeaab023d97c and project b52e5f4c43a3469db851b4704f422448. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:15:40.930159 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-00db472c-63f4-4a28-bdf4-e77606b34d29 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088823 Jul 12 07:15:40.931541 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 179/354] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:15:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:40.978349 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2937a680-bbc9-40bb-94ce-ccccbfccfa7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:40.979350 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2937a680-bbc9-40bb-94ce-ccccbfccfa7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:41.003923 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2937a680-bbc9-40bb-94ce-ccccbfccfa7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:41.005330 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2937a680-bbc9-40bb-94ce-ccccbfccfa7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:41.006155 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2937a680-bbc9-40bb-94ce-ccccbfccfa7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:41.007369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2937a680-bbc9-40bb-94ce-ccccbfccfa7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:41.157128 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2937a680-bbc9-40bb-94ce-ccccbfccfa7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:41.173268 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2937a680-bbc9-40bb-94ce-ccccbfccfa7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1303 microversion: 2.1 time: 0.201240 Jul 12 07:15:41.174552 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 176/355] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:40 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:41.862463 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:41.864694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:41.873694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:41.874607 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:41.876590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:41.878078 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:41.888155 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6f65755d-ea22-467e-a08b-d01ffc668f0c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:41.888768 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6f65755d-ea22-467e-a08b-d01ffc668f0c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:41.903682 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f65755d-ea22-467e-a08b-d01ffc668f0c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:41.904126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f65755d-ea22-467e-a08b-d01ffc668f0c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:41.909611 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f65755d-ea22-467e-a08b-d01ffc668f0c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:41.910242 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6f65755d-ea22-467e-a08b-d01ffc668f0c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:42.292736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:42.302483 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:42.305168 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:42.306846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7fdf0410-55c6-41c0-b3d6-211349f518db tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1747 microversion: 2.20 time: 0.451567 Jul 12 07:15:42.308668 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 180/356] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:41 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1747 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:42.313885 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e6615c51-7466-4837-b5fe-919e029c37b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:42.314921 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e6615c51-7466-4837-b5fe-919e029c37b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:42.321861 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6615c51-7466-4837-b5fe-919e029c37b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:42.322302 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6615c51-7466-4837-b5fe-919e029c37b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:42.327374 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6f65755d-ea22-467e-a08b-d01ffc668f0c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:42.337621 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6615c51-7466-4837-b5fe-919e029c37b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:42.338585 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6615c51-7466-4837-b5fe-919e029c37b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:42.341494 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6f65755d-ea22-467e-a08b-d01ffc668f0c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.457176 Jul 12 07:15:42.342316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 177/357] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:41 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:42.651512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-30324be5-6aaf-4a6d-a081-8aab95cd16f2 req-7b0a575d-b6e8-473d-b5d7-067e904bebec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7ccb04-eb99-4561-9c24-4480c4e0422e", "tag": "696d296b-c149-42d6-896a-50d0d9cc8ad8"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:42.667903 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-30324be5-6aaf-4a6d-a081-8aab95cd16f2 req-7b0a575d-b6e8-473d-b5d7-067e904bebec service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:42.670316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-30324be5-6aaf-4a6d-a081-8aab95cd16f2 req-7b0a575d-b6e8-473d-b5d7-067e904bebec service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:42.694390 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-30324be5-6aaf-4a6d-a081-8aab95cd16f2 req-7b0a575d-b6e8-473d-b5d7-067e904bebec service nova] Creating event network-changed:696d296b-c149-42d6-896a-50d0d9cc8ad8 for instance cf7ccb04-eb99-4561-9c24-4480c4e0422e on hv-cinder-82549 Jul 12 07:15:42.701085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-30324be5-6aaf-4a6d-a081-8aab95cd16f2 req-7b0a575d-b6e8-473d-b5d7-067e904bebec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054741 Jul 12 07:15:42.702258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 178/358] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:42.891864 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-481984721", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d84884e5-7556-4a7f-b022-9bd7a9e42f24"}], "security_groups": [{"name": "tempest-securitygroup--539519304"}], "key_name": "tempest-keypair-574247068", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:43.032462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e6615c51-7466-4837-b5fe-919e029c37b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:43.040224 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e6615c51-7466-4837-b5fe-919e029c37b7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1371 microversion: 2.1 time: 0.730162 Jul 12 07:15:43.041739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 181/359] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:42 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1371 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:43.095908 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] validate_networks() for [('d84884e5-7556-4a7f-b022-9bd7a9e42f24', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:15:43.328121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:43.328997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:43.342014 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:43.342611 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:43.343394 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:43.343989 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:43.817545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:43.839091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:43.839091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:43.841062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d71f974c-c784-4fae-8028-3a1f5814934e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1747 microversion: 2.20 time: 0.517566 Jul 12 07:15:43.850858 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 182/360] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:43 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1747 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:15:43.857511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-307be00e-6880-4a0a-a050-f19c4d4024d8 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:43.858128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-307be00e-6880-4a0a-a050-f19c4d4024d8 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:43.867260 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-307be00e-6880-4a0a-a050-f19c4d4024d8 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:43.867704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-307be00e-6880-4a0a-a050-f19c4d4024d8 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:43.868470 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-307be00e-6880-4a0a-a050-f19c4d4024d8 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:43.869615 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-307be00e-6880-4a0a-a050-f19c4d4024d8 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:44.344324 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-307be00e-6880-4a0a-a050-f19c4d4024d8 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:44.358823 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-307be00e-6880-4a0a-a050-f19c4d4024d8 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.515339 Jul 12 07:15:44.358823 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 183/361] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:43 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:44.372618 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-95749e53-20bb-43ed-9c22-6ebe09b728ee req-2a682bcb-6e86-420a-be93-ce8e9c6076e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dba59c-e816-486d-9296-9fcd6e5a51ff", "name": "network-vif-plugged", "status": "completed", "tag": "e091627f-3767-4ff2-9414-c9935125f0fb"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:44.380718 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-95749e53-20bb-43ed-9c22-6ebe09b728ee req-2a682bcb-6e86-420a-be93-ce8e9c6076e5 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:44.381201 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-95749e53-20bb-43ed-9c22-6ebe09b728ee req-2a682bcb-6e86-420a-be93-ce8e9c6076e5 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:44.393227 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-95749e53-20bb-43ed-9c22-6ebe09b728ee req-2a682bcb-6e86-420a-be93-ce8e9c6076e5 service nova] Creating event network-vif-plugged:e091627f-3767-4ff2-9414-c9935125f0fb for instance e1dba59c-e816-486d-9296-9fcd6e5a51ff on hv-cinder-82549 Jul 12 07:15:44.398480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-95749e53-20bb-43ed-9c22-6ebe09b728ee req-2a682bcb-6e86-420a-be93-ce8e9c6076e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029537 Jul 12 07:15:44.402073 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 184/362] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:44.407598 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4c82a1fb-3529-473e-8f8c-8006f0338b75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:44.408582 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4c82a1fb-3529-473e-8f8c-8006f0338b75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:44.416063 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c82a1fb-3529-473e-8f8c-8006f0338b75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:44.416724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c82a1fb-3529-473e-8f8c-8006f0338b75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:44.418000 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c82a1fb-3529-473e-8f8c-8006f0338b75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:44.418923 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c82a1fb-3529-473e-8f8c-8006f0338b75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:44.429960 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:15:44.430451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:15:44.430822 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:15:44.431221 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:15:44.431621 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:15:44.449783 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:44.450252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:44.451193 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:44.451672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:44.486159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for project b52e5f4c43a3469db851b4704f422448. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:15:44.496109 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for user ef6395fa14b54c43931ffeaab023d97c and project b52e5f4c43a3469db851b4704f422448. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:15:44.509787 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:15:44.512749 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:15:44.593187 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8461963c-dfdc-4eda-a1f5-a0a75daf888a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.705535 Jul 12 07:15:44.594548 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 179/363] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:15:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:15:44.607681 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1209c94b-bfc8-4f97-98bc-c429fb1842c2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:44.608496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1209c94b-bfc8-4f97-98bc-c429fb1842c2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:44.725660 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1209c94b-bfc8-4f97-98bc-c429fb1842c2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:44.734273 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1209c94b-bfc8-4f97-98bc-c429fb1842c2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1240 microversion: 2.1 time: 0.133086 Jul 12 07:15:44.750287 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 180/364] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:44 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:44.786674 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4c82a1fb-3529-473e-8f8c-8006f0338b75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:44.802925 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4c82a1fb-3529-473e-8f8c-8006f0338b75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1371 microversion: 2.1 time: 0.399555 Jul 12 07:15:44.803510 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 185/365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:44 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:44.865167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:44.866556 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:44.877026 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:44.877744 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:44.878870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:44.879560 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:45.015677 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-ce531528-2fb4-4dab-8764-89b511a83300 req-5977512b-d384-451b-a92c-bb940327aec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be899b-3595-4b0a-9e4c-969db0bb9c77", "tag": "713c4298-d251-4d26-895d-e7b0b522105b"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:45.025242 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-ce531528-2fb4-4dab-8764-89b511a83300 req-5977512b-d384-451b-a92c-bb940327aec0 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:45.025679 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-ce531528-2fb4-4dab-8764-89b511a83300 req-5977512b-d384-451b-a92c-bb940327aec0 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:45.037305 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-ce531528-2fb4-4dab-8764-89b511a83300 req-5977512b-d384-451b-a92c-bb940327aec0 service nova] Creating event network-changed:713c4298-d251-4d26-895d-e7b0b522105b for instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 on hv-cinder-82549 Jul 12 07:15:45.043319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-ce531528-2fb4-4dab-8764-89b511a83300 req-5977512b-d384-451b-a92c-bb940327aec0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031402 Jul 12 07:15:45.044319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 186/366] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:15:45.077218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:45.085220 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:45.086711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:45.087892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6daa1254-1134-40eb-bd6b-054734861fe1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1747 microversion: 2.20 time: 0.228513 Jul 12 07:15:45.088448 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 181/367] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:44 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1747 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:45.377585 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-79ab4ba1-b498-49ff-bc30-3bc5faba0886 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:45.377960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-79ab4ba1-b498-49ff-bc30-3bc5faba0886 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:45.379963 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:45.385636 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79ab4ba1-b498-49ff-bc30-3bc5faba0886 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:45.386085 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79ab4ba1-b498-49ff-bc30-3bc5faba0886 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:45.386811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79ab4ba1-b498-49ff-bc30-3bc5faba0886 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:45.387281 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79ab4ba1-b498-49ff-bc30-3bc5faba0886 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:45.524077 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-79ab4ba1-b498-49ff-bc30-3bc5faba0886 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:45.533500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-79ab4ba1-b498-49ff-bc30-3bc5faba0886 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.160772 Jul 12 07:15:45.534083 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 187/368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:45 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:45.753285 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-72c26a4c-f068-4de5-8d4b-09c943f70e4c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:45.753895 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-72c26a4c-f068-4de5-8d4b-09c943f70e4c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:45.760206 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72c26a4c-f068-4de5-8d4b-09c943f70e4c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:45.760649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72c26a4c-f068-4de5-8d4b-09c943f70e4c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:45.761440 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72c26a4c-f068-4de5-8d4b-09c943f70e4c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:45.761874 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-72c26a4c-f068-4de5-8d4b-09c943f70e4c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:45.820596 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-abb887ff-9e8a-4e30-a906-cf9837e23e98 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:45.821221 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-abb887ff-9e8a-4e30-a906-cf9837e23e98 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:45.824711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-72c26a4c-f068-4de5-8d4b-09c943f70e4c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:45.829298 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abb887ff-9e8a-4e30-a906-cf9837e23e98 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:45.829742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abb887ff-9e8a-4e30-a906-cf9837e23e98 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:45.830511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abb887ff-9e8a-4e30-a906-cf9837e23e98 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:45.830941 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abb887ff-9e8a-4e30-a906-cf9837e23e98 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:45.832380 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-72c26a4c-f068-4de5-8d4b-09c943f70e4c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1244 microversion: 2.1 time: 0.083067 Jul 12 07:15:45.832948 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 182/369] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:45 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:45.986925 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-abb887ff-9e8a-4e30-a906-cf9837e23e98 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:46.003415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-abb887ff-9e8a-4e30-a906-cf9837e23e98 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1371 microversion: 2.1 time: 0.187312 Jul 12 07:15:46.004002 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 188/370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:45 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:46.106460 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:46.107097 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:46.114659 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:46.115222 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:46.116114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:46.116553 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:46.256505 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:46.266108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:46.267577 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:46.268752 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-436248eb-4ac6-4e3f-9f2d-ef9911afc84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1747 microversion: 2.20 time: 0.166440 Jul 12 07:15:46.269340 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 183/371] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:46 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1747 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:46.551767 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-92debbbc-7545-4414-af67-e8499ff705b6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:46.552428 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-92debbbc-7545-4414-af67-e8499ff705b6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:46.558837 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92debbbc-7545-4414-af67-e8499ff705b6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:46.559489 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92debbbc-7545-4414-af67-e8499ff705b6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:46.560403 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92debbbc-7545-4414-af67-e8499ff705b6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:46.560985 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92debbbc-7545-4414-af67-e8499ff705b6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:46.724999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-92debbbc-7545-4414-af67-e8499ff705b6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:46.733338 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-92debbbc-7545-4414-af67-e8499ff705b6 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.185801 Jul 12 07:15:46.733900 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 189/372] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:46 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:46.849475 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-eddee1b5-bc66-42fe-8181-eee496b516b9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:46.850050 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-eddee1b5-bc66-42fe-8181-eee496b516b9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:46.856820 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eddee1b5-bc66-42fe-8181-eee496b516b9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:46.857338 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eddee1b5-bc66-42fe-8181-eee496b516b9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:46.858230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eddee1b5-bc66-42fe-8181-eee496b516b9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:46.858663 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eddee1b5-bc66-42fe-8181-eee496b516b9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:46.927719 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-eddee1b5-bc66-42fe-8181-eee496b516b9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:46.938305 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-eddee1b5-bc66-42fe-8181-eee496b516b9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1292 microversion: 2.1 time: 0.092685 Jul 12 07:15:46.938887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 184/373] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:46 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:47.021365 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-63803926-551a-45c3-85d4-bd5244efa4cf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:47.022317 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-63803926-551a-45c3-85d4-bd5244efa4cf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:47.029428 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63803926-551a-45c3-85d4-bd5244efa4cf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:47.030075 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63803926-551a-45c3-85d4-bd5244efa4cf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:47.031062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63803926-551a-45c3-85d4-bd5244efa4cf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:47.031488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63803926-551a-45c3-85d4-bd5244efa4cf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:47.290946 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:47.291831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:47.300594 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:47.322483 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:47.324283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:47.324899 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:47.393107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-63803926-551a-45c3-85d4-bd5244efa4cf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:47.401943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-63803926-551a-45c3-85d4-bd5244efa4cf tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1371 microversion: 2.1 time: 0.385994 Jul 12 07:15:47.403226 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 190/374] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:47 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1371 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:47.602527 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:47.614498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:47.615989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:47.618280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0dad044f-62bc-4c71-a7f4-a1163b00875b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.332563 Jul 12 07:15:47.619293 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 185/375] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:47 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:47.751113 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c92b9512-8ffc-480e-a13e-355edf509fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:47.751820 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c92b9512-8ffc-480e-a13e-355edf509fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:47.758175 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c92b9512-8ffc-480e-a13e-355edf509fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:47.758938 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c92b9512-8ffc-480e-a13e-355edf509fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:47.759987 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c92b9512-8ffc-480e-a13e-355edf509fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:47.760641 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c92b9512-8ffc-480e-a13e-355edf509fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:47.778339 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:47.956036 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-69ca14a9-53a4-40c9-b6df-bfcdc43bfbf4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:47.958989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-69ca14a9-53a4-40c9-b6df-bfcdc43bfbf4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:47.974416 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-69ca14a9-53a4-40c9-b6df-bfcdc43bfbf4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:47.974907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-69ca14a9-53a4-40c9-b6df-bfcdc43bfbf4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:47.975879 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-69ca14a9-53a4-40c9-b6df-bfcdc43bfbf4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:47.976481 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-69ca14a9-53a4-40c9-b6df-bfcdc43bfbf4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:48.244757 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-69ca14a9-53a4-40c9-b6df-bfcdc43bfbf4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:48.260454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-69ca14a9-53a4-40c9-b6df-bfcdc43bfbf4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1298 microversion: 2.1 time: 0.308288 Jul 12 07:15:48.265746 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 186/376] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:47 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1298 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:48.383865 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c92b9512-8ffc-480e-a13e-355edf509fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:48.408094 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c92b9512-8ffc-480e-a13e-355edf509fc0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.661293 Jul 12 07:15:48.425309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-25ad8f63-d50c-46f6-b6d8-334164d3e423 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:48.426321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-25ad8f63-d50c-46f6-b6d8-334164d3e423 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:48.434517 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 191/377] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:47 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:48.441878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25ad8f63-d50c-46f6-b6d8-334164d3e423 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:48.442327 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25ad8f63-d50c-46f6-b6d8-334164d3e423 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:48.443108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25ad8f63-d50c-46f6-b6d8-334164d3e423 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:48.443544 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25ad8f63-d50c-46f6-b6d8-334164d3e423 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:48.639155 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:48.639761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:48.646483 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:48.647166 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:48.648342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:48.648922 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:48.726593 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-25ad8f63-d50c-46f6-b6d8-334164d3e423 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:48.735110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-25ad8f63-d50c-46f6-b6d8-334164d3e423 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1371 microversion: 2.1 time: 0.314472 Jul 12 07:15:48.735998 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 187/378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:48 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:48.911556 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:48.932406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:48.939943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:48.942734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-282255c2-a3e5-4b7f-80e9-ba863adfe361 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.309331 Jul 12 07:15:48.953776 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 192/379] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:48 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:15:49.281701 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-eadd0d5e-88b7-4750-8994-21b50725d21b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:49.282333 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-eadd0d5e-88b7-4750-8994-21b50725d21b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:49.300113 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eadd0d5e-88b7-4750-8994-21b50725d21b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:49.300468 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eadd0d5e-88b7-4750-8994-21b50725d21b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:49.301279 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eadd0d5e-88b7-4750-8994-21b50725d21b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:49.301704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eadd0d5e-88b7-4750-8994-21b50725d21b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:49.426558 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-773d0078-a466-4f7d-93c5-8ec8ff095e90 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:49.427380 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-773d0078-a466-4f7d-93c5-8ec8ff095e90 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:49.433900 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-773d0078-a466-4f7d-93c5-8ec8ff095e90 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:49.434736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-773d0078-a466-4f7d-93c5-8ec8ff095e90 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:49.435775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-773d0078-a466-4f7d-93c5-8ec8ff095e90 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:49.436404 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-773d0078-a466-4f7d-93c5-8ec8ff095e90 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:49.640238 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-eadd0d5e-88b7-4750-8994-21b50725d21b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:49.656860 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-eadd0d5e-88b7-4750-8994-21b50725d21b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.380891 Jul 12 07:15:49.658236 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 188/380] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:49 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:49.687743 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-773d0078-a466-4f7d-93c5-8ec8ff095e90 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:49.699894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-773d0078-a466-4f7d-93c5-8ec8ff095e90 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.277583 Jul 12 07:15:49.712010 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 193/381] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:49 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:49.758097 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e62d0ea1-92b3-4243-9659-15ee947e1479 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:49.759742 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e62d0ea1-92b3-4243-9659-15ee947e1479 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:49.771233 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e62d0ea1-92b3-4243-9659-15ee947e1479 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:49.773285 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e62d0ea1-92b3-4243-9659-15ee947e1479 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:49.775649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e62d0ea1-92b3-4243-9659-15ee947e1479 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:49.776518 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e62d0ea1-92b3-4243-9659-15ee947e1479 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:49.819428 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-8775d32e-9bb7-4373-9b5d-632fe6f146ff req-b3da27da-7668-4137-8120-cc366401bc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59be899b-3595-4b0a-9e4c-969db0bb9c77", "name": "network-vif-plugged", "status": "completed", "tag": "713c4298-d251-4d26-895d-e7b0b522105b"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:49.863022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-8775d32e-9bb7-4373-9b5d-632fe6f146ff req-b3da27da-7668-4137-8120-cc366401bc7c service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:49.866079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-8775d32e-9bb7-4373-9b5d-632fe6f146ff req-b3da27da-7668-4137-8120-cc366401bc7c service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:49.894529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-8775d32e-9bb7-4373-9b5d-632fe6f146ff req-b3da27da-7668-4137-8120-cc366401bc7c service nova] Creating event network-vif-plugged:713c4298-d251-4d26-895d-e7b0b522105b for instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 on hv-cinder-82549 Jul 12 07:15:49.918266 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-8775d32e-9bb7-4373-9b5d-632fe6f146ff req-b3da27da-7668-4137-8120-cc366401bc7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098185 Jul 12 07:15:49.918998 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 194/382] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:15:49.975559 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:49.976701 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:49.991263 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:49.991936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:50.000561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:50.001645 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:50.494720 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e62d0ea1-92b3-4243-9659-15ee947e1479 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:50.506986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e62d0ea1-92b3-4243-9659-15ee947e1479 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1371 microversion: 2.1 time: 0.756698 Jul 12 07:15:50.507878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 189/383] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:49 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1371 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:50.570426 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:50.595482 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:50.599742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:50.602717 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d8dc2e35-2554-4cd8-bcb2-2a8ce8498dc3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.634591 Jul 12 07:15:50.615747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 195/384] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:49 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:15:50.674688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-b6ff06c3-8ef5-43d0-82ce-5a7c9d64e100 req-9916af58-7779-47c8-acc7-cd857548755b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eceb7063-d7f3-4616-93d5-661faeb663d2", "tag": "37513402-e1c1-4226-a854-1aceb5986036"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:50.691063 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1e84ec92-5879-4d04-84ea-29f4d95f7b22 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:50.695681 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-b6ff06c3-8ef5-43d0-82ce-5a7c9d64e100 req-9916af58-7779-47c8-acc7-cd857548755b service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:50.696068 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1e84ec92-5879-4d04-84ea-29f4d95f7b22 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:50.700258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-b6ff06c3-8ef5-43d0-82ce-5a7c9d64e100 req-9916af58-7779-47c8-acc7-cd857548755b service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:50.710868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e84ec92-5879-4d04-84ea-29f4d95f7b22 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:50.711310 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e84ec92-5879-4d04-84ea-29f4d95f7b22 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:50.712068 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e84ec92-5879-4d04-84ea-29f4d95f7b22 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:50.712495 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e84ec92-5879-4d04-84ea-29f4d95f7b22 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:50.741157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-b6ff06c3-8ef5-43d0-82ce-5a7c9d64e100 req-9916af58-7779-47c8-acc7-cd857548755b service nova] Creating event network-changed:37513402-e1c1-4226-a854-1aceb5986036 for instance eceb7063-d7f3-4616-93d5-661faeb663d2 on hv-cinder-82549 Jul 12 07:15:50.757333 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-b6ff06c3-8ef5-43d0-82ce-5a7c9d64e100 req-9916af58-7779-47c8-acc7-cd857548755b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088172 Jul 12 07:15:50.758643 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 190/385] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:50.764912 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-adf7c606-55d4-4e92-ab59-1e53bea8f08b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:50.774153 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-adf7c606-55d4-4e92-ab59-1e53bea8f08b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:50.790623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-adf7c606-55d4-4e92-ab59-1e53bea8f08b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:50.791297 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-adf7c606-55d4-4e92-ab59-1e53bea8f08b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:50.792259 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-adf7c606-55d4-4e92-ab59-1e53bea8f08b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:50.793547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-adf7c606-55d4-4e92-ab59-1e53bea8f08b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:50.913140 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=4 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:51.120298 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1e84ec92-5879-4d04-84ea-29f4d95f7b22 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:51.130629 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1e84ec92-5879-4d04-84ea-29f4d95f7b22 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.452368 Jul 12 07:15:51.131331 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 196/386] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:50 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:51.185662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-adf7c606-55d4-4e92-ab59-1e53bea8f08b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:51.202480 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-adf7c606-55d4-4e92-ab59-1e53bea8f08b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.442352 Jul 12 07:15:51.219906 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 191/387] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:50 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:51.526717 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-94f4d512-3248-4e82-92b3-e19ddafeb717 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:51.527684 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-94f4d512-3248-4e82-92b3-e19ddafeb717 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:51.536487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94f4d512-3248-4e82-92b3-e19ddafeb717 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:51.537117 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94f4d512-3248-4e82-92b3-e19ddafeb717 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:51.537903 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94f4d512-3248-4e82-92b3-e19ddafeb717 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:51.538337 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94f4d512-3248-4e82-92b3-e19ddafeb717 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:51.625207 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:51.626748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:51.634230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:51.635234 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:51.636029 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:51.636483 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:51.823716 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-94f4d512-3248-4e82-92b3-e19ddafeb717 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:51.848479 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-94f4d512-3248-4e82-92b3-e19ddafeb717 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1371 microversion: 2.1 time: 0.325460 Jul 12 07:15:51.849519 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 197/388] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:51 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:51.886289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:51.900507 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:51.906004 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:51.907768 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cd85d565-107b-4338-a62c-05a9d5629e44 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.289762 Jul 12 07:15:51.921470 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 192/389] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:51 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:52.157597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-071415a5-38e8-4b5d-846f-702769a830c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:52.158957 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-071415a5-38e8-4b5d-846f-702769a830c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:52.165806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-071415a5-38e8-4b5d-846f-702769a830c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:52.166605 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-071415a5-38e8-4b5d-846f-702769a830c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:52.167363 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-071415a5-38e8-4b5d-846f-702769a830c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:52.167788 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-071415a5-38e8-4b5d-846f-702769a830c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:52.226113 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-43337ad7-564b-45a0-aaf9-7c4539354dca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:52.227324 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-43337ad7-564b-45a0-aaf9-7c4539354dca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:52.234304 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43337ad7-564b-45a0-aaf9-7c4539354dca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:52.235051 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43337ad7-564b-45a0-aaf9-7c4539354dca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:52.236019 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43337ad7-564b-45a0-aaf9-7c4539354dca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:52.236677 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43337ad7-564b-45a0-aaf9-7c4539354dca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:52.378376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-071415a5-38e8-4b5d-846f-702769a830c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:52.388816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-071415a5-38e8-4b5d-846f-702769a830c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.236679 Jul 12 07:15:52.389746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 198/390] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:52 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:52.444247 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-43337ad7-564b-45a0-aaf9-7c4539354dca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:52.455859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-43337ad7-564b-45a0-aaf9-7c4539354dca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1725 microversion: 2.1 time: 0.236151 Jul 12 07:15:52.456594 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 193/391] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:52 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:52.865677 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4b4fc25a-5fc0-4c9f-9e7e-f8ee7061959b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:52.866581 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4b4fc25a-5fc0-4c9f-9e7e-f8ee7061959b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:52.875475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b4fc25a-5fc0-4c9f-9e7e-f8ee7061959b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:52.876197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b4fc25a-5fc0-4c9f-9e7e-f8ee7061959b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:52.877170 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b4fc25a-5fc0-4c9f-9e7e-f8ee7061959b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:52.877866 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b4fc25a-5fc0-4c9f-9e7e-f8ee7061959b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:52.930543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:52.932052 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:52.945647 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:52.946370 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:52.947335 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:52.947966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:52.965747 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:53.168260 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4b4fc25a-5fc0-4c9f-9e7e-f8ee7061959b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:53.176907 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4b4fc25a-5fc0-4c9f-9e7e-f8ee7061959b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1565 microversion: 2.1 time: 0.315127 Jul 12 07:15:53.197759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 199/392] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:52 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1565 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:53.203445 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-483101ec-e0ee-4b10-bfe5-e95b9332078b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:53.204139 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-483101ec-e0ee-4b10-bfe5-e95b9332078b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:53.211206 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-483101ec-e0ee-4b10-bfe5-e95b9332078b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:53.211930 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-483101ec-e0ee-4b10-bfe5-e95b9332078b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:53.212889 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-483101ec-e0ee-4b10-bfe5-e95b9332078b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:53.213325 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-483101ec-e0ee-4b10-bfe5-e95b9332078b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:53.218126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:53.232447 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:53.233961 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:53.235116 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5aa1f9e7-743d-416c-9b27-a13dcfae4ed8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.309276 Jul 12 07:15:53.235887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 194/393] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:52 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:53.364111 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-483101ec-e0ee-4b10-bfe5-e95b9332078b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163872 Jul 12 07:15:53.365608 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 200/394] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 07:15:53 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:53.405879 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3976a885-0b21-4b51-af67-9d986c08494b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:53.406396 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3976a885-0b21-4b51-af67-9d986c08494b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:53.423362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3976a885-0b21-4b51-af67-9d986c08494b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:53.424116 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3976a885-0b21-4b51-af67-9d986c08494b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:53.425081 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3976a885-0b21-4b51-af67-9d986c08494b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:53.425658 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3976a885-0b21-4b51-af67-9d986c08494b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:53.476852 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aba134c6-ecc6-435a-807b-65f85b4e6557 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:53.477824 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aba134c6-ecc6-435a-807b-65f85b4e6557 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:53.490065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aba134c6-ecc6-435a-807b-65f85b4e6557 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:53.490791 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aba134c6-ecc6-435a-807b-65f85b4e6557 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:53.491701 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aba134c6-ecc6-435a-807b-65f85b4e6557 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:53.492272 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aba134c6-ecc6-435a-807b-65f85b4e6557 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:53.858987 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3976a885-0b21-4b51-af67-9d986c08494b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:53.862750 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aba134c6-ecc6-435a-807b-65f85b4e6557 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:53.878683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aba134c6-ecc6-435a-807b-65f85b4e6557 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1702 microversion: 2.1 time: 0.401807 Jul 12 07:15:53.890387 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 201/395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:53 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1702 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:15:53.890745 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3976a885-0b21-4b51-af67-9d986c08494b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.482257 Jul 12 07:15:53.896342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0f3e6eda-71ff-42b3-9fb3-51a65852260c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:53.899637 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 195/396] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:53 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:53.903237 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f3e6eda-71ff-42b3-9fb3-51a65852260c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:53.904232 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f3e6eda-71ff-42b3-9fb3-51a65852260c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:53.929304 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f3e6eda-71ff-42b3-9fb3-51a65852260c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Going to try to start instance {{(pid=117997) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 07:15:54.012312 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0f3e6eda-71ff-42b3-9fb3-51a65852260c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/action" status: 202 len: 0 microversion: 2.1 time: 0.115612 Jul 12 07:15:54.012312 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 202/397] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:15:53 2022] POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 07:15:54.018226 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-18ac54f5-ca05-4710-bbc1-c953b69c2e35 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:54.018994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-18ac54f5-ca05-4710-bbc1-c953b69c2e35 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:54.026617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18ac54f5-ca05-4710-bbc1-c953b69c2e35 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:54.028166 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18ac54f5-ca05-4710-bbc1-c953b69c2e35 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:54.029329 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18ac54f5-ca05-4710-bbc1-c953b69c2e35 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:54.030109 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18ac54f5-ca05-4710-bbc1-c953b69c2e35 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:54.229864 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-18ac54f5-ca05-4710-bbc1-c953b69c2e35 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:54.240343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-18ac54f5-ca05-4710-bbc1-c953b69c2e35 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1711 microversion: 2.1 time: 0.226327 Jul 12 07:15:54.241336 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 196/398] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:54 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1711 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:54.258887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:54.258887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:54.271698 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:54.272149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:54.272940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:54.273413 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:54.494479 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:54.505763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:54.507481 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:54.508831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6c381755-d5d1-437a-ab4b-be7c94f9eeb0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.254855 Jul 12 07:15:54.520298 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 203/399] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:54 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:54.672618 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-edda0b94-732c-4416-b7e7-bfe7b05b3888 req-f536c820-a003-448d-bc9b-ba4fb28802b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be899b-3595-4b0a-9e4c-969db0bb9c77", "tag": "713c4298-d251-4d26-895d-e7b0b522105b"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:15:54.676431 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=4 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:54.683120 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-edda0b94-732c-4416-b7e7-bfe7b05b3888 req-f536c820-a003-448d-bc9b-ba4fb28802b9 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:54.683851 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-edda0b94-732c-4416-b7e7-bfe7b05b3888 req-f536c820-a003-448d-bc9b-ba4fb28802b9 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:54.698824 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-edda0b94-732c-4416-b7e7-bfe7b05b3888 req-f536c820-a003-448d-bc9b-ba4fb28802b9 service nova] Creating event network-changed:713c4298-d251-4d26-895d-e7b0b522105b for instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 on hv-cinder-82549 Jul 12 07:15:54.704849 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-edda0b94-732c-4416-b7e7-bfe7b05b3888 req-f536c820-a003-448d-bc9b-ba4fb28802b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035857 Jul 12 07:15:54.709509 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 197/400] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:15:54.906239 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e8300428-503e-4641-90f5-84684f01879a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:54.907170 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e8300428-503e-4641-90f5-84684f01879a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:54.924492 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8300428-503e-4641-90f5-84684f01879a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:54.925579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8300428-503e-4641-90f5-84684f01879a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:54.926604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8300428-503e-4641-90f5-84684f01879a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:54.927195 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8300428-503e-4641-90f5-84684f01879a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:55.207806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e8300428-503e-4641-90f5-84684f01879a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:55.216473 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e8300428-503e-4641-90f5-84684f01879a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.314058 Jul 12 07:15:55.238415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 204/401] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:54 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:55.257373 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=20 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:55.262552 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d1532f23-4715-4096-b0a3-cf3989c7ab0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:55.263543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d1532f23-4715-4096-b0a3-cf3989c7ab0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:55.281943 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d1532f23-4715-4096-b0a3-cf3989c7ab0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:55.282398 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d1532f23-4715-4096-b0a3-cf3989c7ab0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:55.283191 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d1532f23-4715-4096-b0a3-cf3989c7ab0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:55.283628 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d1532f23-4715-4096-b0a3-cf3989c7ab0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:55.528754 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:55.529742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:55.536664 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:55.537121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:55.537881 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:55.549520 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:55.613270 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d1532f23-4715-4096-b0a3-cf3989c7ab0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:55.622994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d1532f23-4715-4096-b0a3-cf3989c7ab0d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1711 microversion: 2.1 time: 0.366460 Jul 12 07:15:55.629610 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 198/402] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:55 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1711 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:55.899136 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:55.908356 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:55.910415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:55.911816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-afecdd83-03df-4c65-99ef-09310462d7b7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.388167 Jul 12 07:15:55.928460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 205/403] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:55 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:15:56.246401 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-750b926d-16c2-48d6-980e-74999a8fc239 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:56.247398 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-750b926d-16c2-48d6-980e-74999a8fc239 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:56.254029 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-750b926d-16c2-48d6-980e-74999a8fc239 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:56.254704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-750b926d-16c2-48d6-980e-74999a8fc239 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:56.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-750b926d-16c2-48d6-980e-74999a8fc239 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:56.265300 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-750b926d-16c2-48d6-980e-74999a8fc239 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:56.482218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-750b926d-16c2-48d6-980e-74999a8fc239 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:56.490392 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-750b926d-16c2-48d6-980e-74999a8fc239 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.248047 Jul 12 07:15:56.500505 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 199/404] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:56 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:56.646152 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8ce9a6b9-6a7f-4265-9f0e-1feddb510de1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:56.647419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8ce9a6b9-6a7f-4265-9f0e-1feddb510de1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:56.654493 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ce9a6b9-6a7f-4265-9f0e-1feddb510de1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:56.654981 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ce9a6b9-6a7f-4265-9f0e-1feddb510de1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:56.655832 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ce9a6b9-6a7f-4265-9f0e-1feddb510de1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:56.656341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ce9a6b9-6a7f-4265-9f0e-1feddb510de1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:56.832416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8ce9a6b9-6a7f-4265-9f0e-1feddb510de1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:56.853160 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8ce9a6b9-6a7f-4265-9f0e-1feddb510de1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1711 microversion: 2.1 time: 0.212966 Jul 12 07:15:56.866486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 206/405] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:56 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1711 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:56.931203 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:56.931864 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:56.939349 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:56.941746 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:56.942746 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:56.943474 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:57.116635 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:57.126460 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:57.127953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:57.129173 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ebe2bac1-9d5d-4c32-a9c4-94094795da32 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.202331 Jul 12 07:15:57.129750 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 200/406] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:56 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:57.507869 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-489643fe-ac20-476f-820c-ce1cb97ec5fa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:57.508474 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-489643fe-ac20-476f-820c-ce1cb97ec5fa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:57.516251 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-489643fe-ac20-476f-820c-ce1cb97ec5fa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:57.516686 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-489643fe-ac20-476f-820c-ce1cb97ec5fa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:57.517487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-489643fe-ac20-476f-820c-ce1cb97ec5fa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:57.518066 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-489643fe-ac20-476f-820c-ce1cb97ec5fa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:57.677855 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-489643fe-ac20-476f-820c-ce1cb97ec5fa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:57.687370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-489643fe-ac20-476f-820c-ce1cb97ec5fa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.183408 Jul 12 07:15:57.688149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 207/407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:57 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:57.874054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-25a0e70e-7245-46b8-8aa3-31e880f4d7ce tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:57.874777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-25a0e70e-7245-46b8-8aa3-31e880f4d7ce tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:57.882616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25a0e70e-7245-46b8-8aa3-31e880f4d7ce tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:57.883452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25a0e70e-7245-46b8-8aa3-31e880f4d7ce tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:57.884426 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25a0e70e-7245-46b8-8aa3-31e880f4d7ce tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:57.885086 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-25a0e70e-7245-46b8-8aa3-31e880f4d7ce tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:58.037201 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-25a0e70e-7245-46b8-8aa3-31e880f4d7ce tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:58.046647 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-25a0e70e-7245-46b8-8aa3-31e880f4d7ce tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1715 microversion: 2.1 time: 0.177943 Jul 12 07:15:58.047228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 201/408] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:57 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1715 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:58.148249 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:58.148856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:58.156977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:58.157456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:58.158236 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:58.158659 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:58.175558 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:15:58.295897 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:58.305474 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:58.307013 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:58.308204 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-04caed6e-127c-4aae-8eb1-e4f9d07d6f3f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.164082 Jul 12 07:15:58.308769 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 208/409] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:58 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:58.709880 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3ee42147-49c9-47a9-917e-74930bb6ca56 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:58.710863 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3ee42147-49c9-47a9-917e-74930bb6ca56 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:58.721353 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ee42147-49c9-47a9-917e-74930bb6ca56 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:58.722091 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ee42147-49c9-47a9-917e-74930bb6ca56 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:58.723317 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ee42147-49c9-47a9-917e-74930bb6ca56 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:58.724027 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ee42147-49c9-47a9-917e-74930bb6ca56 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:58.856822 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3ee42147-49c9-47a9-917e-74930bb6ca56 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:58.864980 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3ee42147-49c9-47a9-917e-74930bb6ca56 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.161657 Jul 12 07:15:58.865597 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 202/410] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:58 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:15:59.328064 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:59.328796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:59.335556 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:59.335995 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:59.336747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:59.337217 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:59.472175 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:59.480312 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:59.482257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:15:59.483399 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d215aa65-79d0-42de-8276-5951c01c61cb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1742 microversion: 2.20 time: 0.160079 Jul 12 07:15:59.483969 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 209/411] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:15:59 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:15:59.882420 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3b46efef-38fb-4fdb-a92d-aeac57784391 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:15:59.883700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3b46efef-38fb-4fdb-a92d-aeac57784391 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:15:59.892171 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b46efef-38fb-4fdb-a92d-aeac57784391 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:59.892608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b46efef-38fb-4fdb-a92d-aeac57784391 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:15:59.893454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b46efef-38fb-4fdb-a92d-aeac57784391 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:15:59.893884 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b46efef-38fb-4fdb-a92d-aeac57784391 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:00.029825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3b46efef-38fb-4fdb-a92d-aeac57784391 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:00.037436 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3b46efef-38fb-4fdb-a92d-aeac57784391 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.158894 Jul 12 07:16:00.038006 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 203/412] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:15:59 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:00.501718 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:00.502276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:00.508536 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:00.508934 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:00.509931 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:00.510354 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:00.719185 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:00.727514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:00.728992 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:00.730171 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0ffe6291-2e07-491a-9ab7-8fff82d3d495 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1724 microversion: 2.20 time: 0.232424 Jul 12 07:16:00.730717 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 210/413] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:00 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:01.055260 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-88a4da33-44b5-4a94-b33d-cf11ae4e46c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:01.055857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-88a4da33-44b5-4a94-b33d-cf11ae4e46c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:01.062572 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a4da33-44b5-4a94-b33d-cf11ae4e46c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:01.063016 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a4da33-44b5-4a94-b33d-cf11ae4e46c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:01.063771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a4da33-44b5-4a94-b33d-cf11ae4e46c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:01.064192 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-88a4da33-44b5-4a94-b33d-cf11ae4e46c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:01.203700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-88a4da33-44b5-4a94-b33d-cf11ae4e46c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:01.211646 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-88a4da33-44b5-4a94-b33d-cf11ae4e46c1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.160215 Jul 12 07:16:01.212221 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 204/414] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:01 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:01.749076 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:01.749740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:01.756251 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:01.756693 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:01.757503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:01.757934 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:01.845192 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-71d3bad0-1f88-4c90-ac1b-61bb7d01e300 req-f6da0992-9471-406b-b6ff-fed227212ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eceb7063-d7f3-4616-93d5-661faeb663d2", "name": "network-vif-plugged", "status": "completed", "tag": "37513402-e1c1-4226-a854-1aceb5986036"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:16:01.854374 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-71d3bad0-1f88-4c90-ac1b-61bb7d01e300 req-f6da0992-9471-406b-b6ff-fed227212ed8 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:01.855419 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-71d3bad0-1f88-4c90-ac1b-61bb7d01e300 req-f6da0992-9471-406b-b6ff-fed227212ed8 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:01.867106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-71d3bad0-1f88-4c90-ac1b-61bb7d01e300 req-f6da0992-9471-406b-b6ff-fed227212ed8 service nova] Creating event network-vif-plugged:37513402-e1c1-4226-a854-1aceb5986036 for instance eceb7063-d7f3-4616-93d5-661faeb663d2 on hv-cinder-82549 Jul 12 07:16:01.872578 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-71d3bad0-1f88-4c90-ac1b-61bb7d01e300 req-f6da0992-9471-406b-b6ff-fed227212ed8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030720 Jul 12 07:16:01.873150 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 205/415] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:16:01.890283 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:01.898540 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:01.900027 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:01.901205 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e8751786-e608-4586-8301-50eb33c2aef4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1724 microversion: 2.20 time: 0.156556 Jul 12 07:16:01.901765 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 211/416] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:01 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:02.232957 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9753a1b7-11f2-480d-95a1-a20bf64769e0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:02.233716 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9753a1b7-11f2-480d-95a1-a20bf64769e0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:02.240982 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9753a1b7-11f2-480d-95a1-a20bf64769e0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:02.241452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9753a1b7-11f2-480d-95a1-a20bf64769e0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:02.242200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9753a1b7-11f2-480d-95a1-a20bf64769e0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:02.242633 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9753a1b7-11f2-480d-95a1-a20bf64769e0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:02.379936 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9753a1b7-11f2-480d-95a1-a20bf64769e0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:02.388088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9753a1b7-11f2-480d-95a1-a20bf64769e0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.162165 Jul 12 07:16:02.388637 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 206/417] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:02 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:02.922269 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:02.923003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:02.929865 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:02.930304 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:02.931091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:02.931475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:03.068675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:03.077351 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:03.079442 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:03.080601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c074aeda-61f4-42d2-9ace-cff7fcb692d5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1724 microversion: 2.20 time: 0.164294 Jul 12 07:16:03.081174 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 212/418] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:02 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:03.404555 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-14a74317-df28-470f-adc1-9b1d36fda0ad tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:03.405135 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-14a74317-df28-470f-adc1-9b1d36fda0ad tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:03.412173 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-14a74317-df28-470f-adc1-9b1d36fda0ad tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:03.412611 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-14a74317-df28-470f-adc1-9b1d36fda0ad tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:03.413400 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-14a74317-df28-470f-adc1-9b1d36fda0ad tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:03.413824 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-14a74317-df28-470f-adc1-9b1d36fda0ad tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:03.542938 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-14a74317-df28-470f-adc1-9b1d36fda0ad tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:03.550966 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-14a74317-df28-470f-adc1-9b1d36fda0ad tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.150413 Jul 12 07:16:03.551527 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 207/419] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:03 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:04.105460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:04.106450 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:04.117315 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.118050 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:04.119286 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.119997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:04.255930 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:04.268332 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:04.270926 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:04.272678 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-999e3356-929d-4dd0-8e8b-3987e5f09339 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1727 microversion: 2.20 time: 0.173729 Jul 12 07:16:04.273487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 213/420] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:04 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:04.295093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-43a4d82c-21b3-45fa-b9bd-d276c8771785 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25afcd9a-b696-4613-b444-172dde3050d7"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:16:04.296157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-43a4d82c-21b3-45fa-b9bd-d276c8771785 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:04.302576 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43a4d82c-21b3-45fa-b9bd-d276c8771785 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.302983 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43a4d82c-21b3-45fa-b9bd-d276c8771785 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:04.303723 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43a4d82c-21b3-45fa-b9bd-d276c8771785 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.304149 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43a4d82c-21b3-45fa-b9bd-d276c8771785 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:04.571240 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-42c2794f-513c-4cdc-8e2a-95b28f8f0bd2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:04.572020 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-42c2794f-513c-4cdc-8e2a-95b28f8f0bd2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:04.579809 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42c2794f-513c-4cdc-8e2a-95b28f8f0bd2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.580355 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42c2794f-513c-4cdc-8e2a-95b28f8f0bd2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:04.581220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42c2794f-513c-4cdc-8e2a-95b28f8f0bd2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.581986 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42c2794f-513c-4cdc-8e2a-95b28f8f0bd2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:04.690232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-43a4d82c-21b3-45fa-b9bd-d276c8771785 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.398990 Jul 12 07:16:04.692219 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 208/421] 10.222.0.25 () {62 vars in 1363 bytes} [Tue Jul 12 07:16:04 2022] POST /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments => generated 188 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:16:04.783958 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-42c2794f-513c-4cdc-8e2a-95b28f8f0bd2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:04.794108 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-42c2794f-513c-4cdc-8e2a-95b28f8f0bd2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1365 microversion: 2.1 time: 0.228503 Jul 12 07:16:04.794584 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 214/422] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:04 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:04.832444 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6099ca8f-91c5-43e9-b206-d4307a5c831b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:16:04.833005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6099ca8f-91c5-43e9-b206-d4307a5c831b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:04.839287 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6099ca8f-91c5-43e9-b206-d4307a5c831b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.839733 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6099ca8f-91c5-43e9-b206-d4307a5c831b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:04.840475 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6099ca8f-91c5-43e9-b206-d4307a5c831b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.840902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6099ca8f-91c5-43e9-b206-d4307a5c831b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:04.879331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:16:04.891465 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:16:04.942001 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6099ca8f-91c5-43e9-b206-d4307a5c831b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/action" status: 202 len: 0 microversion: 2.20 time: 0.114304 Jul 12 07:16:04.942613 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 209/423] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 12 07:16:04 2022] POST /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:16:04.950705 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:04.951298 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:04.957964 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.958401 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:04.959152 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:04.959587 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:05.114104 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:05.123622 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:05.125140 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:05.126378 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d19cf31-d38e-4c48-b7f9-998ec78a2647 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1753 microversion: 2.20 time: 0.179544 Jul 12 07:16:05.127276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 215/424] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:04 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:05.807473 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-785e40da-a8dd-45d5-89ac-a5e1532f33b9 req-aa73881d-b5f2-4e1f-88bb-9086dc096d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dba59c-e816-486d-9296-9fcd6e5a51ff", "name": "network-vif-unplugged", "status": "completed", "tag": "e091627f-3767-4ff2-9414-c9935125f0fb"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:16:05.813141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ecac158b-63bd-4e84-b10c-e4855f010bd9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:05.814467 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ecac158b-63bd-4e84-b10c-e4855f010bd9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:05.834051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecac158b-63bd-4e84-b10c-e4855f010bd9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:05.834498 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecac158b-63bd-4e84-b10c-e4855f010bd9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:05.835648 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecac158b-63bd-4e84-b10c-e4855f010bd9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:05.835737 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecac158b-63bd-4e84-b10c-e4855f010bd9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:05.846565 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-785e40da-a8dd-45d5-89ac-a5e1532f33b9 req-aa73881d-b5f2-4e1f-88bb-9086dc096d6e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:05.848593 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-785e40da-a8dd-45d5-89ac-a5e1532f33b9 req-aa73881d-b5f2-4e1f-88bb-9086dc096d6e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:05.870831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.compute.server_external_events [req-785e40da-a8dd-45d5-89ac-a5e1532f33b9 req-aa73881d-b5f2-4e1f-88bb-9086dc096d6e service nova] Unable to find a host for instance e1dba59c-e816-486d-9296-9fcd6e5a51ff. Dropping event network-vif-unplugged {{(pid=117998) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 07:16:05.872137 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-785e40da-a8dd-45d5-89ac-a5e1532f33b9 req-aa73881d-b5f2-4e1f-88bb-9086dc096d6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.068556 Jul 12 07:16:05.873507 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 210/425] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 07:16:06.145205 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:06.145812 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:06.153399 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:06.153399 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:06.153716 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:06.154280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:06.191209 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ecac158b-63bd-4e84-b10c-e4855f010bd9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:06.200740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ecac158b-63bd-4e84-b10c-e4855f010bd9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1555 microversion: 2.1 time: 0.391325 Jul 12 07:16:06.201709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 216/426] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:05 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1555 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:06.219744 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-31e293f8-71cc-4e38-b115-2e3eb467710b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:06.220470 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-31e293f8-71cc-4e38-b115-2e3eb467710b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:06.226910 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31e293f8-71cc-4e38-b115-2e3eb467710b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:06.227428 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31e293f8-71cc-4e38-b115-2e3eb467710b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:06.228251 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31e293f8-71cc-4e38-b115-2e3eb467710b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:06.228744 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31e293f8-71cc-4e38-b115-2e3eb467710b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:06.370473 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-31e293f8-71cc-4e38-b115-2e3eb467710b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155347 Jul 12 07:16:06.376679 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 217/427] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 07:16:06 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:16:06.414087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:06.424500 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:06.426028 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:06.427215 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cc45ffdf-4a97-4bde-955e-cb2344790157 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1753 microversion: 2.20 time: 0.286166 Jul 12 07:16:06.437836 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 211/428] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:06 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1753 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:16:07.445989 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:07.446580 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:07.452745 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:07.453212 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:07.454122 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:07.454554 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:07.560971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-aa4a4db4-2fad-497d-aa03-d384766aa3c1 req-d852e525-9a79-4803-9d48-e696c06b966c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eceb7063-d7f3-4616-93d5-661faeb663d2", "tag": "37513402-e1c1-4226-a854-1aceb5986036"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:16:07.569994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-aa4a4db4-2fad-497d-aa03-d384766aa3c1 req-d852e525-9a79-4803-9d48-e696c06b966c service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:07.570550 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-aa4a4db4-2fad-497d-aa03-d384766aa3c1 req-d852e525-9a79-4803-9d48-e696c06b966c service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:07.583069 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-aa4a4db4-2fad-497d-aa03-d384766aa3c1 req-d852e525-9a79-4803-9d48-e696c06b966c service nova] Creating event network-changed:37513402-e1c1-4226-a854-1aceb5986036 for instance eceb7063-d7f3-4616-93d5-661faeb663d2 on hv-cinder-82549 Jul 12 07:16:07.587030 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:07.588827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-aa4a4db4-2fad-497d-aa03-d384766aa3c1 req-d852e525-9a79-4803-9d48-e696c06b966c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031538 Jul 12 07:16:07.589994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 212/429] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:16:07.595531 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:07.597077 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:07.598204 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4191b2af-1b8d-4950-9e83-a039aad0840c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1755 microversion: 2.20 time: 0.156348 Jul 12 07:16:07.598751 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 218/430] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:07 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1755 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:08.617005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:08.617693 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:08.624467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:08.624911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:08.625756 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:08.626265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:08.763982 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:08.775048 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:08.777385 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:08.778881 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-385ebd0c-4783-48a8-b492-2a4058ed64a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1755 microversion: 2.20 time: 0.166053 Jul 12 07:16:08.779441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 213/431] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:08 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:09.798870 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:09.799645 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:09.806827 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:09.807264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:09.808011 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:09.808432 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:10.022099 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:10.030702 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:10.032182 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:10.033400 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b5e374ee-a669-4007-bc25-4b98e0d9cd0e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1755 microversion: 2.20 time: 0.238611 Jul 12 07:16:10.034017 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 219/432] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:09 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:11.053103 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:11.053673 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:11.060801 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:11.061184 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:11.061931 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:11.062357 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:11.215478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:11.228215 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:11.230394 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:11.232111 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-491af0a4-00e5-4e45-a7d4-e1515e851c72 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.182875 Jul 12 07:16:11.232857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 214/433] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:11 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:12.251899 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:12.252609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:12.259108 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:12.259546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:12.260276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:12.260697 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:12.389803 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:12.398803 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:12.400299 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:12.401484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1923d679-9e58-49ca-bd0e-6e06ee374dad tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.153971 Jul 12 07:16:12.402027 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 220/434] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:12 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:13.420422 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:13.421036 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:13.428443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:13.428885 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:13.429684 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:13.430114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:13.566417 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:13.575607 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:13.577291 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:13.578525 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-35293b90-f44a-4585-a89d-ed8019fb4278 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.162150 Jul 12 07:16:13.579149 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 215/435] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:13 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:14.597940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:14.599633 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:14.606416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:14.606862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:14.607627 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:14.608055 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:14.742661 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:14.751347 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:14.752899 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:14.754127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-59fc3eee-f1d4-40ed-bbb1-c3e744703cab tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.160496 Jul 12 07:16:14.754915 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 221/436] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:14 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:15.773950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:15.775899 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:15.783594 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:15.784771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:15.786489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:15.787258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:16.008690 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:16.020474 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:16.022161 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:16.023307 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-94875b78-4012-4d51-ba57-af1dd4527c47 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.255301 Jul 12 07:16:16.024439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 216/437] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:15 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:17.043289 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:17.043936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:17.045846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=70 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:16:17.051683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:17.052013 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:17.052920 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:17.053366 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:17.198207 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:17.207952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:17.209500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:17.210669 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-feabb62a-95ee-4cb4-88a3-0544b9319bc8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.171721 Jul 12 07:16:17.211570 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 222/438] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:17 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:18.229538 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:18.230180 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:18.236580 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:18.237011 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:18.237797 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:18.238217 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:18.375297 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:18.384497 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:18.386333 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:18.387583 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6cd82b5b-5313-4ba1-aec8-163aa26cf110 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.162193 Jul 12 07:16:18.388216 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 217/439] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:18 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:19.407179 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:19.407835 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:19.415232 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:19.415662 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:19.416449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:19.416878 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:19.560670 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:19.571008 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:19.572651 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:19.573832 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0217ee82-3a37-4100-b297-9ddb1a21b36e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.170846 Jul 12 07:16:19.577469 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 223/440] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:19 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:20.593857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:20.594523 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:20.602171 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:20.602694 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:20.603465 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:20.603888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:20.744534 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:20.753371 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:20.754868 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:20.756231 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8bc55059-2921-4b8d-92b9-aa42cfdba809 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.166276 Jul 12 07:16:20.756794 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 218/441] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:20 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:21.774963 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:21.775600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:21.781943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:21.782386 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:21.783169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:21.783588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:21.925248 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:21.934744 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:21.936238 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:21.937430 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-df189462-90fa-416a-8d8d-96336cf362a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.166573 Jul 12 07:16:21.937998 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 224/442] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:21 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:22.956939 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:22.957975 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:22.966454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:22.966950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:22.967800 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:22.968204 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:23.150195 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:23.163600 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:23.165876 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:23.167257 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-191c76a5-a13e-4501-9e45-41524f0b6f0b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.214825 Jul 12 07:16:23.167980 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 219/443] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:22 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:24.192323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:24.193347 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:24.199949 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:24.200399 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:24.201182 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:24.201609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:24.204108 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:16:24.333109 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:24.345815 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:24.348173 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:24.349836 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4fb35b55-ba19-4680-a351-e9fa529395a9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.163129 Jul 12 07:16:24.350392 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 225/444] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:24 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:25.370208 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:25.370806 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:25.377797 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:25.378239 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:25.378983 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:25.379407 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:25.513112 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:25.521952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:25.523446 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:25.524587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8a8494de-9414-442a-8d44-8630620ccd11 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.158291 Jul 12 07:16:25.525141 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 220/445] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:25 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:26.547424 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:26.548377 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:26.558853 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:26.559569 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:26.560844 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:26.561617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:26.717902 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:26.731141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:26.733546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:26.735339 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-66a3d600-040c-4119-b52a-723127b04b2c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.194362 Jul 12 07:16:26.736130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 226/446] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:26 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:27.758740 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:27.759690 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:27.771106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:27.771832 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:27.772964 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:27.773420 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:27.913028 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:27.926475 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:27.928770 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:27.930579 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7db504ec-b5b3-4a7d-87c0-47654542c342 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.178252 Jul 12 07:16:27.931370 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 221/447] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:27 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:28.958370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:28.959623 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:28.966244 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:28.966718 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:28.967487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:28.967927 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:29.111832 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:29.121763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:29.123286 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:29.124429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4e01ae33-b9f2-4f17-9af4-b843378d9a97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.172807 Jul 12 07:16:29.125030 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 227/448] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:28 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:30.146859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:30.148483 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:30.158878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:30.159609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:30.160858 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:30.161622 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:30.295645 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:30.304903 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:30.306431 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:30.307584 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5c8495b0-b701-4514-8fe3-9128fef6ab54 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.167303 Jul 12 07:16:30.308143 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 222/449] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:30 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:31.330500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:31.331411 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:31.339143 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:31.339585 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:31.340326 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:31.340747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:31.470750 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:31.483607 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:31.485985 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:31.487796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c882bc1d-e0ec-4cf9-9c9b-b56e49d544a4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.163718 Jul 12 07:16:31.488597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 228/450] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:31 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:32.511346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:32.512353 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:32.523631 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:32.524331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:32.525704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:32.526405 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:32.671379 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:32.682398 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:32.683880 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:32.685015 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cf332d43-9cf9-4a99-993a-e7d3ae45dbe9 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.180365 Jul 12 07:16:32.685604 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 223/451] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:32 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:33.708267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:33.709547 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:33.716414 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:33.716879 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:33.717702 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:33.718150 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:33.856141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:33.864694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:33.866229 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:33.867374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8061465a-91bd-42a7-a9cd-6f2efdbaf28d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.165805 Jul 12 07:16:33.867916 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 229/452] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:33 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:34.890478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:34.891461 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:34.895257 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=30 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:16:34.901995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:34.902430 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:34.903178 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:34.903599 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:34.918734 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:16:35.041317 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:35.049777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:35.051253 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:35.052392 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3d7c304e-f982-4b28-ab1f-dc024d5ab9cd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.168507 Jul 12 07:16:35.052946 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 224/453] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:34 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:36.071571 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:36.072184 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:36.078531 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:36.078970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:36.079716 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:36.080156 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:36.212206 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:36.221102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:36.223029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:36.224490 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3662b710-3b9b-470a-a80e-7a98d39e9923 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.156805 Jul 12 07:16:36.225315 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 230/454] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:36 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:37.251753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:37.252585 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:37.261860 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:37.262307 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:37.263064 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:37.263491 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:37.397082 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:37.409952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:37.412264 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:37.414367 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5dde32d4-ce5d-4a3d-8413-d747915a3ca7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.169273 Jul 12 07:16:37.414927 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 225/455] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:37 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:38.018015 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-d65eb2ff-733a-410f-9331-4ee518ef09fa req-c52d19bd-6e9f-4e43-9047-819c1b03e3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dba59c-e816-486d-9296-9fcd6e5a51ff", "name": "network-vif-plugged", "status": "completed", "tag": "e091627f-3767-4ff2-9414-c9935125f0fb"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:16:38.026872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-d65eb2ff-733a-410f-9331-4ee518ef09fa req-c52d19bd-6e9f-4e43-9047-819c1b03e3d8 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:38.027307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-d65eb2ff-733a-410f-9331-4ee518ef09fa req-c52d19bd-6e9f-4e43-9047-819c1b03e3d8 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:38.039370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-d65eb2ff-733a-410f-9331-4ee518ef09fa req-c52d19bd-6e9f-4e43-9047-819c1b03e3d8 service nova] Creating event network-vif-plugged:e091627f-3767-4ff2-9414-c9935125f0fb for instance e1dba59c-e816-486d-9296-9fcd6e5a51ff on hv-cinder-82549 Jul 12 07:16:38.044471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-d65eb2ff-733a-410f-9331-4ee518ef09fa req-c52d19bd-6e9f-4e43-9047-819c1b03e3d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030109 Jul 12 07:16:38.045043 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 231/456] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:16:38.436792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:38.437755 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:38.448929 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:38.449807 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:38.451055 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:38.451761 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:38.589953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:38.601939 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:38.604197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:38.605386 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b02bc1b5-c283-4d29-b58e-50424b79a2e4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.175067 Jul 12 07:16:38.605907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 226/457] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:38 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:39.629669 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:39.630846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:39.638488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:39.638953 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:39.639706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:39.640135 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:39.772870 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:39.781626 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:39.783127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:39.784280 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fc344b4e-7328-4bd8-9fce-03d4b4d94cdb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.162077 Jul 12 07:16:39.784829 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 232/458] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:39 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:40.803223 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:40.803766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:40.810680 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:40.811117 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:40.811880 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:40.812299 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:40.943366 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:40.952069 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:40.953777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:40.954979 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-21e8a3dc-10d4-4330-a0e2-134e2d2a01ff tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1811 microversion: 2.20 time: 0.155757 Jul 12 07:16:40.955531 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 227/459] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:40 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:41.977291 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:41.977911 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:41.984347 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:41.984918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:41.985628 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:41.986055 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:42.135890 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:42.149182 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:42.150798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:42.151949 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fab4539e-f06c-4b4d-a104-8eebd67f8766 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1798 microversion: 2.20 time: 0.181027 Jul 12 07:16:42.152508 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 233/460] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:16:41 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1798 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:16:42.643108 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:16:42.643441 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Tue Jul 12 07:16:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:16:47.598991 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d95a7b1a-3f79-408f-bae9-1913debecb8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:47.599871 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d95a7b1a-3f79-408f-bae9-1913debecb8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:47.608007 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d95a7b1a-3f79-408f-bae9-1913debecb8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:47.608450 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d95a7b1a-3f79-408f-bae9-1913debecb8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:47.609237 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d95a7b1a-3f79-408f-bae9-1913debecb8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:47.609691 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d95a7b1a-3f79-408f-bae9-1913debecb8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:47.739886 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-d95a7b1a-3f79-408f-bae9-1913debecb8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lazy-loading 'services' on Instance uuid aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:16:47.864156 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d95a7b1a-3f79-408f-bae9-1913debecb8b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/os-volume_attachments/8924e168-0e72-4d92-b491-e9e1610316bb" status: 202 len: 0 microversion: 2.1 time: 0.271564 Jul 12 07:16:47.864679 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 228/461] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:16:47 2022] DELETE /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/os-volume_attachments/8924e168-0e72-4d92-b491-e9e1610316bb => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:16:48.980544 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-22df008a-2c39-459f-82ff-d65a334d727a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:16:48.982943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=24 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:16:48.988743 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22df008a-2c39-459f-82ff-d65a334d727a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:48.989374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22df008a-2c39-459f-82ff-d65a334d727a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:49.017921 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-22df008a-2c39-459f-82ff-d65a334d727a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Going to try to stop instance {{(pid=117997) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 07:16:49.063915 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-22df008a-2c39-459f-82ff-d65a334d727a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/action" status: 202 len: 0 microversion: 2.1 time: 0.088152 Jul 12 07:16:49.064514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 234/462] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:16:48 2022] POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:16:49.074216 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-20667cdc-6d7a-4449-a695-7e5758ad31e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:49.074920 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-20667cdc-6d7a-4449-a695-7e5758ad31e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:49.081991 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20667cdc-6d7a-4449-a695-7e5758ad31e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:49.082541 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20667cdc-6d7a-4449-a695-7e5758ad31e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:49.083296 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20667cdc-6d7a-4449-a695-7e5758ad31e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:49.083741 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20667cdc-6d7a-4449-a695-7e5758ad31e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:49.218171 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-20667cdc-6d7a-4449-a695-7e5758ad31e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:49.226380 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-20667cdc-6d7a-4449-a695-7e5758ad31e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1679 microversion: 2.1 time: 0.157361 Jul 12 07:16:49.226958 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 229/463] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:49 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:16:50.244636 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f24f8c73-7f92-4923-ab55-a2c7db7a911c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:50.245427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f24f8c73-7f92-4923-ab55-a2c7db7a911c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:50.252228 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f24f8c73-7f92-4923-ab55-a2c7db7a911c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:50.252598 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f24f8c73-7f92-4923-ab55-a2c7db7a911c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:50.253401 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f24f8c73-7f92-4923-ab55-a2c7db7a911c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:50.253807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f24f8c73-7f92-4923-ab55-a2c7db7a911c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:50.385930 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f24f8c73-7f92-4923-ab55-a2c7db7a911c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:50.394248 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f24f8c73-7f92-4923-ab55-a2c7db7a911c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1679 microversion: 2.1 time: 0.154030 Jul 12 07:16:50.394814 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 235/464] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:50 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:51.416317 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7e58f3bd-bda1-420b-8640-15b502abf4c3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:51.417466 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7e58f3bd-bda1-420b-8640-15b502abf4c3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:51.425358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e58f3bd-bda1-420b-8640-15b502abf4c3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:51.425857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e58f3bd-bda1-420b-8640-15b502abf4c3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:51.426737 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e58f3bd-bda1-420b-8640-15b502abf4c3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:51.427215 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7e58f3bd-bda1-420b-8640-15b502abf4c3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:51.568114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7e58f3bd-bda1-420b-8640-15b502abf4c3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:51.575912 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7e58f3bd-bda1-420b-8640-15b502abf4c3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1679 microversion: 2.1 time: 0.166507 Jul 12 07:16:51.576480 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 230/465] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:51 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:52.598647 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1dd552aa-1e2b-4ae8-ab4b-46338e87cf98 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:52.599662 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1dd552aa-1e2b-4ae8-ab4b-46338e87cf98 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:52.609947 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dd552aa-1e2b-4ae8-ab4b-46338e87cf98 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:52.610673 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dd552aa-1e2b-4ae8-ab4b-46338e87cf98 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:52.611901 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dd552aa-1e2b-4ae8-ab4b-46338e87cf98 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:52.612605 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dd552aa-1e2b-4ae8-ab4b-46338e87cf98 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:52.762965 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1dd552aa-1e2b-4ae8-ab4b-46338e87cf98 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:52.770574 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1dd552aa-1e2b-4ae8-ab4b-46338e87cf98 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1679 microversion: 2.1 time: 0.178709 Jul 12 07:16:52.771141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 236/466] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:52 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:53.095166 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6cbd217b-5b42-4e96-85c9-e001a5604c5b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbc8b6ba-e0b9-445a-8f72-f3c48ef88029"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:16:53.096284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6cbd217b-5b42-4e96-85c9-e001a5604c5b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:53.103301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cbd217b-5b42-4e96-85c9-e001a5604c5b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:53.103751 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cbd217b-5b42-4e96-85c9-e001a5604c5b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:53.104510 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cbd217b-5b42-4e96-85c9-e001a5604c5b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:53.105013 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cbd217b-5b42-4e96-85c9-e001a5604c5b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:53.383681 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6cbd217b-5b42-4e96-85c9-e001a5604c5b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292497 Jul 12 07:16:53.384292 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 231/467] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:16:53 2022] POST /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:16:53.788757 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-120dfe82-5b71-4c1f-983c-4dd3d88c13ad tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:53.789414 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-120dfe82-5b71-4c1f-983c-4dd3d88c13ad tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:53.796019 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-120dfe82-5b71-4c1f-983c-4dd3d88c13ad tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:53.796395 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-120dfe82-5b71-4c1f-983c-4dd3d88c13ad tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:53.797165 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-120dfe82-5b71-4c1f-983c-4dd3d88c13ad tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:53.797593 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-120dfe82-5b71-4c1f-983c-4dd3d88c13ad tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:53.934254 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-120dfe82-5b71-4c1f-983c-4dd3d88c13ad tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:53.942055 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-120dfe82-5b71-4c1f-983c-4dd3d88c13ad tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1679 microversion: 2.1 time: 0.157597 Jul 12 07:16:53.942620 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 237/468] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:53 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:54.965087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b0bbd444-649e-4da5-8508-e79610379c4c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:54.965782 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b0bbd444-649e-4da5-8508-e79610379c4c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:54.972700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b0bbd444-649e-4da5-8508-e79610379c4c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:54.973166 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b0bbd444-649e-4da5-8508-e79610379c4c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:54.973917 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b0bbd444-649e-4da5-8508-e79610379c4c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:54.974346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b0bbd444-649e-4da5-8508-e79610379c4c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:55.115796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b0bbd444-649e-4da5-8508-e79610379c4c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:55.133431 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b0bbd444-649e-4da5-8508-e79610379c4c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1679 microversion: 2.1 time: 0.175207 Jul 12 07:16:55.134454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 232/469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:54 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:56.155228 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3413cac7-250b-41b4-899c-5de835765928 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:56.155911 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3413cac7-250b-41b4-899c-5de835765928 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:56.163836 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3413cac7-250b-41b4-899c-5de835765928 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:56.164345 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3413cac7-250b-41b4-899c-5de835765928 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:56.165255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3413cac7-250b-41b4-899c-5de835765928 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:56.165757 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3413cac7-250b-41b4-899c-5de835765928 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:56.168878 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:16:56.300199 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3413cac7-250b-41b4-899c-5de835765928 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:56.307790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3413cac7-250b-41b4-899c-5de835765928 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1679 microversion: 2.1 time: 0.158415 Jul 12 07:16:56.308358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 238/470] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:56 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:57.335121 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8a4fa115-6442-4dfc-a827-c47940f0fcdf tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:57.336010 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8a4fa115-6442-4dfc-a827-c47940f0fcdf tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:57.346196 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a4fa115-6442-4dfc-a827-c47940f0fcdf tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:57.346644 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a4fa115-6442-4dfc-a827-c47940f0fcdf tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:57.347408 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a4fa115-6442-4dfc-a827-c47940f0fcdf tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:57.347876 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a4fa115-6442-4dfc-a827-c47940f0fcdf tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:57.492579 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8a4fa115-6442-4dfc-a827-c47940f0fcdf tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:57.500808 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8a4fa115-6442-4dfc-a827-c47940f0fcdf tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1679 microversion: 2.1 time: 0.172380 Jul 12 07:16:57.501384 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 233/471] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:57 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:58.522491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-869796cc-18a7-4edc-a06f-b7c6ebb46f18 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:58.523437 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-869796cc-18a7-4edc-a06f-b7c6ebb46f18 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:58.534001 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-869796cc-18a7-4edc-a06f-b7c6ebb46f18 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:58.534719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-869796cc-18a7-4edc-a06f-b7c6ebb46f18 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:58.535954 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-869796cc-18a7-4edc-a06f-b7c6ebb46f18 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:58.536665 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-869796cc-18a7-4edc-a06f-b7c6ebb46f18 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:58.673381 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-869796cc-18a7-4edc-a06f-b7c6ebb46f18 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:58.685543 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-869796cc-18a7-4edc-a06f-b7c6ebb46f18 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1679 microversion: 2.1 time: 0.169156 Jul 12 07:16:58.686499 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 239/472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:58 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:59.707855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4e4b2049-ccaa-40e9-8951-11725264e52b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:59.708826 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4e4b2049-ccaa-40e9-8951-11725264e52b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:59.719451 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4e4b2049-ccaa-40e9-8951-11725264e52b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:59.719896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4e4b2049-ccaa-40e9-8951-11725264e52b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:59.720660 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4e4b2049-ccaa-40e9-8951-11725264e52b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:59.721091 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4e4b2049-ccaa-40e9-8951-11725264e52b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:59.862524 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4e4b2049-ccaa-40e9-8951-11725264e52b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:16:59.873835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4e4b2049-ccaa-40e9-8951-11725264e52b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1656 microversion: 2.1 time: 0.172420 Jul 12 07:16:59.874773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 234/473] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:59 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1656 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:16:59.891474 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ce1f50b8-3bfb-4c14-bb65-ec45df188833 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:16:59.897987 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce1f50b8-3bfb-4c14-bb65-ec45df188833 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:59.898424 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce1f50b8-3bfb-4c14-bb65-ec45df188833 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:59.922435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ce1f50b8-3bfb-4c14-bb65-ec45df188833 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Going to try to start instance {{(pid=117997) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 07:16:59.972296 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ce1f50b8-3bfb-4c14-bb65-ec45df188833 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/action" status: 202 len: 0 microversion: 2.1 time: 0.084711 Jul 12 07:16:59.972946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 240/474] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:16:59 2022] POST /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:16:59.981076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-63875d45-0fba-449f-8512-6a28750a6e91 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:16:59.981650 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-63875d45-0fba-449f-8512-6a28750a6e91 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:16:59.989080 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63875d45-0fba-449f-8512-6a28750a6e91 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:59.989540 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63875d45-0fba-449f-8512-6a28750a6e91 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:16:59.990371 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63875d45-0fba-449f-8512-6a28750a6e91 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:16:59.990814 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63875d45-0fba-449f-8512-6a28750a6e91 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:00.134117 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-63875d45-0fba-449f-8512-6a28750a6e91 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:00.141971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-63875d45-0fba-449f-8512-6a28750a6e91 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1665 microversion: 2.1 time: 0.164752 Jul 12 07:17:00.142537 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 235/475] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:16:59 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:00.926332 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-23b5834c-16e5-4fce-aa56-5e128ac65c5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:00.927724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-23b5834c-16e5-4fce-aa56-5e128ac65c5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:00.934218 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23b5834c-16e5-4fce-aa56-5e128ac65c5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:00.934653 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23b5834c-16e5-4fce-aa56-5e128ac65c5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:00.936261 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23b5834c-16e5-4fce-aa56-5e128ac65c5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:00.936705 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23b5834c-16e5-4fce-aa56-5e128ac65c5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:00.966327 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-23b5834c-16e5-4fce-aa56-5e128ac65c5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lazy-loading 'flavor' on Instance uuid 59be899b-3595-4b0a-9e4c-969db0bb9c77 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:17:01.102331 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-23b5834c-16e5-4fce-aa56-5e128ac65c5c tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/action" status: 200 len: 32 microversion: 2.1 time: 0.181439 Jul 12 07:17:01.102840 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 241/476] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:17:00 2022] POST /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:17:01.112226 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bff96364-7f13-4bfc-ae31-9fe2da50967f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:01.112828 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bff96364-7f13-4bfc-ae31-9fe2da50967f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:01.119441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bff96364-7f13-4bfc-ae31-9fe2da50967f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:01.119887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bff96364-7f13-4bfc-ae31-9fe2da50967f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:01.120648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bff96364-7f13-4bfc-ae31-9fe2da50967f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:01.121097 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bff96364-7f13-4bfc-ae31-9fe2da50967f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:01.160071 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-076b33e1-819e-4dd5-ac87-107bfbaab3e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:01.160750 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-076b33e1-819e-4dd5-ac87-107bfbaab3e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:01.167667 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-076b33e1-819e-4dd5-ac87-107bfbaab3e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:01.168110 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-076b33e1-819e-4dd5-ac87-107bfbaab3e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:01.168851 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-076b33e1-819e-4dd5-ac87-107bfbaab3e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:01.169308 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-076b33e1-819e-4dd5-ac87-107bfbaab3e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:01.366697 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bff96364-7f13-4bfc-ae31-9fe2da50967f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:01.375538 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bff96364-7f13-4bfc-ae31-9fe2da50967f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.266988 Jul 12 07:17:01.376155 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 236/477] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:01 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:01.432307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-076b33e1-819e-4dd5-ac87-107bfbaab3e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:01.441603 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-076b33e1-819e-4dd5-ac87-107bfbaab3e1 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1665 microversion: 2.1 time: 0.285723 Jul 12 07:17:01.442813 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 242/478] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:01 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1665 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:17:02.394230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-87bb2a4c-8a1f-4a50-9b34-a54d5ae6ff71 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:02.394895 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-87bb2a4c-8a1f-4a50-9b34-a54d5ae6ff71 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:02.401859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-87bb2a4c-8a1f-4a50-9b34-a54d5ae6ff71 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.402313 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-87bb2a4c-8a1f-4a50-9b34-a54d5ae6ff71 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:02.403053 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-87bb2a4c-8a1f-4a50-9b34-a54d5ae6ff71 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.403476 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-87bb2a4c-8a1f-4a50-9b34-a54d5ae6ff71 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:02.459564 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-06420f7e-026a-480b-989b-dd6561f0f042 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:02.460177 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-06420f7e-026a-480b-989b-dd6561f0f042 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:02.466471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06420f7e-026a-480b-989b-dd6561f0f042 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.466909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06420f7e-026a-480b-989b-dd6561f0f042 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:02.467691 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06420f7e-026a-480b-989b-dd6561f0f042 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.468117 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06420f7e-026a-480b-989b-dd6561f0f042 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:02.806632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-87bb2a4c-8a1f-4a50-9b34-a54d5ae6ff71 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:02.815281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-87bb2a4c-8a1f-4a50-9b34-a54d5ae6ff71 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.425044 Jul 12 07:17:02.815853 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 237/479] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:02 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:02.828854 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7a985c33-b7cd-4380-bddd-79bb9c182bf5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:02.829411 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7a985c33-b7cd-4380-bddd-79bb9c182bf5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:02.835655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a985c33-b7cd-4380-bddd-79bb9c182bf5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.836100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a985c33-b7cd-4380-bddd-79bb9c182bf5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:02.836860 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a985c33-b7cd-4380-bddd-79bb9c182bf5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.837320 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a985c33-b7cd-4380-bddd-79bb9c182bf5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:02.857339 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-06420f7e-026a-480b-989b-dd6561f0f042 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:02.860661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7a985c33-b7cd-4380-bddd-79bb9c182bf5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2/ips" status: 200 len: 149 microversion: 2.1 time: 0.035863 Jul 12 07:17:02.861254 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 238/480] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:17:02 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:02.865947 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-06420f7e-026a-480b-989b-dd6561f0f042 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1669 microversion: 2.1 time: 0.410370 Jul 12 07:17:02.866620 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 243/481] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:02 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1669 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:02.871608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "243b2933-867d-4d16-a908-157f079ab1ff"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:02.872954 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:02.879794 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.880231 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:02.880976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.881427 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:02.896974 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:02.973017 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Invalid volume: volume 243b2933-867d-4d16-a908-157f079ab1ff is already attached to instances: e99231ef-ba9f-4294-87ab-e47992b4f001 Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: POST /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2/os-volume_attachments HTTP/1.1 Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 74 Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:17:02.975057 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {"volumeAttachment": {"volumeId": "243b2933-867d-4d16-a908-157f079ab1ff"}} Jul 12 07:17:02.976502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Invalid volume: volume 243b2933-867d-4d16-a908-157f079ab1ff is already attached to instances: e99231ef-ba9f-4294-87ab-e47992b4f001 Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'server_id': 'eceb7063-d7f3-4616-93d5-661faeb663d2', 'body': {'volumeAttachment': {'volumeId': '243b2933-867d-4d16-a908-157f079ab1ff'}}} Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 243b2933-867d-4d16-a908-157f079ab1ff is already attached to instances: e99231ef-ba9f-4294-87ab-e47992b4f001 Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:02.977543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 243b2933-867d-4d16-a908-157f079ab1ff is already attached to instances: e99231ef-ba9f-4294-87ab-e47992b4f001 Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:02.978986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:02.980623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:02.980623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:17:02.980623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:17:02.980623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 243b2933-867d-4d16-a908-157f079ab1ff is already attached to instances: e99231ef-ba9f-4294-87ab-e47992b4f001 Jul 12 07:17:02.980623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:02.980623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 400 to user: Invalid volume: volume 243b2933-867d-4d16-a908-157f079ab1ff is already attached to instances: e99231ef-ba9f-4294-87ab-e47992b4f001 {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:17:02.980623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bdadc6d7-5508-48a0-a4a6-b0e3e8f87ca3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108606 Jul 12 07:17:02.980623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 239/482] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:17:02 2022] POST /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:17:02.986465 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-77eb3a50-cd91-41e6-ad5e-4f693a3fb81a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:02.987020 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-77eb3a50-cd91-41e6-ad5e-4f693a3fb81a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:02.995705 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77eb3a50-cd91-41e6-ad5e-4f693a3fb81a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.996159 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77eb3a50-cd91-41e6-ad5e-4f693a3fb81a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:02.996962 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77eb3a50-cd91-41e6-ad5e-4f693a3fb81a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:02.997393 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77eb3a50-cd91-41e6-ad5e-4f693a3fb81a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:03.028858 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-77eb3a50-cd91-41e6-ad5e-4f693a3fb81a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:17:03.119586 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-77eb3a50-cd91-41e6-ad5e-4f693a3fb81a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 204 len: 0 microversion: 2.1 time: 0.137426 Jul 12 07:17:03.120095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 244/483] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:17:02 2022] DELETE /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:17:03.129582 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6358de89-9057-4172-8359-80405204dbfa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:03.130578 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6358de89-9057-4172-8359-80405204dbfa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:03.137563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6358de89-9057-4172-8359-80405204dbfa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:03.137992 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6358de89-9057-4172-8359-80405204dbfa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:03.138763 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6358de89-9057-4172-8359-80405204dbfa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:03.139200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6358de89-9057-4172-8359-80405204dbfa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:03.281180 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6358de89-9057-4172-8359-80405204dbfa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:03.293936 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6358de89-9057-4172-8359-80405204dbfa tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1679 microversion: 2.1 time: 0.168087 Jul 12 07:17:03.294835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 240/484] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:03 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:03.835535 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99072c85-44f4-4ddf-a7d7-1519f50fac49 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:03.836376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-99072c85-44f4-4ddf-a7d7-1519f50fac49 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:03.844629 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99072c85-44f4-4ddf-a7d7-1519f50fac49 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:03.845224 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99072c85-44f4-4ddf-a7d7-1519f50fac49 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:03.846159 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99072c85-44f4-4ddf-a7d7-1519f50fac49 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:03.846682 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99072c85-44f4-4ddf-a7d7-1519f50fac49 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:03.988728 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-99072c85-44f4-4ddf-a7d7-1519f50fac49 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:04.000149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-99072c85-44f4-4ddf-a7d7-1519f50fac49 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.170482 Jul 12 07:17:04.000858 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 245/485] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:03 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:04.318577 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9175014c-51f4-42e4-a65d-3ac2923e09b7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:04.319185 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9175014c-51f4-42e4-a65d-3ac2923e09b7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:04.328956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9175014c-51f4-42e4-a65d-3ac2923e09b7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:04.329429 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9175014c-51f4-42e4-a65d-3ac2923e09b7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:04.330189 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9175014c-51f4-42e4-a65d-3ac2923e09b7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:04.330622 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9175014c-51f4-42e4-a65d-3ac2923e09b7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:04.469636 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9175014c-51f4-42e4-a65d-3ac2923e09b7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:04.477592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9175014c-51f4-42e4-a65d-3ac2923e09b7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1679 microversion: 2.1 time: 0.162934 Jul 12 07:17:04.478166 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 241/486] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:04 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:05.018480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bbea4352-a78c-4817-8ecb-cdb112e5830d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:05.019093 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bbea4352-a78c-4817-8ecb-cdb112e5830d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:05.025599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bbea4352-a78c-4817-8ecb-cdb112e5830d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:05.026036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bbea4352-a78c-4817-8ecb-cdb112e5830d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:05.026810 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bbea4352-a78c-4817-8ecb-cdb112e5830d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:05.027215 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bbea4352-a78c-4817-8ecb-cdb112e5830d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:05.321640 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bbea4352-a78c-4817-8ecb-cdb112e5830d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:05.330775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bbea4352-a78c-4817-8ecb-cdb112e5830d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.316566 Jul 12 07:17:05.331480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 246/487] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:05 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:05.495799 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f38edcba-74ae-48cd-8c46-3ffecf05c80d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:05.496516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f38edcba-74ae-48cd-8c46-3ffecf05c80d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:05.498987 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=36 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:05.505287 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f38edcba-74ae-48cd-8c46-3ffecf05c80d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:05.505724 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f38edcba-74ae-48cd-8c46-3ffecf05c80d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:05.506606 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f38edcba-74ae-48cd-8c46-3ffecf05c80d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:05.507038 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f38edcba-74ae-48cd-8c46-3ffecf05c80d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:05.808991 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f38edcba-74ae-48cd-8c46-3ffecf05c80d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:05.817197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f38edcba-74ae-48cd-8c46-3ffecf05c80d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1679 microversion: 2.1 time: 0.325468 Jul 12 07:17:05.817776 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 242/488] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:05 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1679 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:06.298501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-4b7173e5-11b0-45b4-8eff-cf2bf96ec0db req-7c635877-2a58-4ab3-96a7-d1e462c47d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eceb7063-d7f3-4616-93d5-661faeb663d2", "name": "network-vif-deleted", "tag": "37513402-e1c1-4226-a854-1aceb5986036"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:06.307217 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4b7173e5-11b0-45b4-8eff-cf2bf96ec0db req-7c635877-2a58-4ab3-96a7-d1e462c47d56 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:06.307797 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4b7173e5-11b0-45b4-8eff-cf2bf96ec0db req-7c635877-2a58-4ab3-96a7-d1e462c47d56 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:06.320045 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-4b7173e5-11b0-45b4-8eff-cf2bf96ec0db req-7c635877-2a58-4ab3-96a7-d1e462c47d56 service nova] Creating event network-vif-deleted:37513402-e1c1-4226-a854-1aceb5986036 for instance eceb7063-d7f3-4616-93d5-661faeb663d2 on hv-cinder-82549 Jul 12 07:17:06.325462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-4b7173e5-11b0-45b4-8eff-cf2bf96ec0db req-7c635877-2a58-4ab3-96a7-d1e462c47d56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030152 Jul 12 07:17:06.326036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 247/489] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:06.348248 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a7d32e65-7224-4c55-a3b9-712f6354210f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:06.349002 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a7d32e65-7224-4c55-a3b9-712f6354210f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:06.355329 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7d32e65-7224-4c55-a3b9-712f6354210f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:06.355893 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7d32e65-7224-4c55-a3b9-712f6354210f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:06.356995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7d32e65-7224-4c55-a3b9-712f6354210f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:06.357472 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7d32e65-7224-4c55-a3b9-712f6354210f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:06.518772 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a7d32e65-7224-4c55-a3b9-712f6354210f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:06.526977 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a7d32e65-7224-4c55-a3b9-712f6354210f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.182631 Jul 12 07:17:06.527587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 243/490] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:06 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:06.835475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:06.836146 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:06.843423 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:06.844452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:06.845469 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:06.845890 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:06.900931 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:06.901309 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:06.901738 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lazy-loading 'fault' on Instance uuid eceb7063-d7f3-4616-93d5-661faeb663d2 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:17:06.955217 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:06.963113 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a86f9525-153d-42cd-9012-306b2e02d8d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 200 len: 1330 microversion: 2.1 time: 0.131862 Jul 12 07:17:06.963686 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 248/491] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:06 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 1330 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:07.544941 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-21b031ad-b369-451b-90d6-af798ddae3d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:07.545559 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-21b031ad-b369-451b-90d6-af798ddae3d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:07.553272 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21b031ad-b369-451b-90d6-af798ddae3d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:07.553714 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21b031ad-b369-451b-90d6-af798ddae3d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:07.554490 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21b031ad-b369-451b-90d6-af798ddae3d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:07.554920 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21b031ad-b369-451b-90d6-af798ddae3d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:07.692878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-21b031ad-b369-451b-90d6-af798ddae3d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:07.701667 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-21b031ad-b369-451b-90d6-af798ddae3d7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.160427 Jul 12 07:17:07.702289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 244/492] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:07 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:07.984712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:07.985867 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:07.997865 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:07.997865 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:07.999094 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:07.999094 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:08.013756 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 HTTP/1.1 Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:17:08.015415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:17:08.016733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'eceb7063-d7f3-4616-93d5-661faeb663d2'} Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:17:08.017486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:17:08.018846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:08.020301 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:17:08.020301 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c40a2532-7979-4c09-bb10-34bf500846d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 404 len: 111 microversion: 2.1 time: 0.038685 Jul 12 07:17:08.020301 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 249/493] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:07 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:17:08.026048 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bdf0afd3-a23b-401b-a321-9231e7882d93 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '.version_select at 0x7f701182adc0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:08.047928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bdf0afd3-a23b-401b-a321-9231e7882d93 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-574247068" status: 202 len: 0 microversion: 2.1 time: 0.025682 Jul 12 07:17:08.048459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 245/494] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 12 07:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-574247068 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 07:17:08.719623 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-720d15e9-d049-4381-8933-5ea9efdc46d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:08.720224 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-720d15e9-d049-4381-8933-5ea9efdc46d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:08.724800 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8c52d301-8cde-458b-bca3-172414a02301 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:08.725454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8c52d301-8cde-458b-bca3-172414a02301 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:08.726352 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-720d15e9-d049-4381-8933-5ea9efdc46d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:08.726791 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-720d15e9-d049-4381-8933-5ea9efdc46d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:08.727543 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-720d15e9-d049-4381-8933-5ea9efdc46d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:08.727966 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-720d15e9-d049-4381-8933-5ea9efdc46d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:08.732006 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c52d301-8cde-458b-bca3-172414a02301 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:08.732446 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c52d301-8cde-458b-bca3-172414a02301 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:08.733251 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c52d301-8cde-458b-bca3-172414a02301 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:08.733680 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c52d301-8cde-458b-bca3-172414a02301 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:08.814669 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-8c52d301-8cde-458b-bca3-172414a02301 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lazy-loading 'services' on Instance uuid e99231ef-ba9f-4294-87ab-e47992b4f001 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:17:08.862574 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-720d15e9-d049-4381-8933-5ea9efdc46d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:08.870905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-720d15e9-d049-4381-8933-5ea9efdc46d2 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.155293 Jul 12 07:17:08.871464 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 250/495] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:08 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:08.889020 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8c52d301-8cde-458b-bca3-172414a02301 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-volume_attachments/243b2933-867d-4d16-a908-157f079ab1ff" status: 202 len: 0 microversion: 2.1 time: 0.168829 Jul 12 07:17:08.889645 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 246/496] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:17:08 2022] DELETE /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-volume_attachments/243b2933-867d-4d16-a908-157f079ab1ff => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:17:08.898307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-987e3940-ac76-4aa1-b1c5-accb921dd461 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:08.899445 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-987e3940-ac76-4aa1-b1c5-accb921dd461 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:08.905509 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-987e3940-ac76-4aa1-b1c5-accb921dd461 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:08.905952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-987e3940-ac76-4aa1-b1c5-accb921dd461 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:08.906711 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-987e3940-ac76-4aa1-b1c5-accb921dd461 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:08.907156 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-987e3940-ac76-4aa1-b1c5-accb921dd461 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:08.909734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:08.938784 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-987e3940-ac76-4aa1-b1c5-accb921dd461 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Jul 12 07:17:08.939355 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 251/497] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:17:08 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:17:09.890889 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0155dbb2-6359-4b17-b8b8-915ee633b1aa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:09.892230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0155dbb2-6359-4b17-b8b8-915ee633b1aa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:09.898892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0155dbb2-6359-4b17-b8b8-915ee633b1aa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:09.899334 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0155dbb2-6359-4b17-b8b8-915ee633b1aa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:09.900110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0155dbb2-6359-4b17-b8b8-915ee633b1aa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:09.900570 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0155dbb2-6359-4b17-b8b8-915ee633b1aa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:09.951392 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b65dda9d-d0a7-4a5f-bd6f-fff24e5179b2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:09.952962 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b65dda9d-d0a7-4a5f-bd6f-fff24e5179b2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:09.959834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b65dda9d-d0a7-4a5f-bd6f-fff24e5179b2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:09.960297 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b65dda9d-d0a7-4a5f-bd6f-fff24e5179b2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:09.961147 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b65dda9d-d0a7-4a5f-bd6f-fff24e5179b2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:09.961643 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b65dda9d-d0a7-4a5f-bd6f-fff24e5179b2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:09.994618 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b65dda9d-d0a7-4a5f-bd6f-fff24e5179b2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047682 Jul 12 07:17:10.001086 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 252/498] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:17:09 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 07:17:10.043123 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0155dbb2-6359-4b17-b8b8-915ee633b1aa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:10.052025 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0155dbb2-6359-4b17-b8b8-915ee633b1aa tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.167869 Jul 12 07:17:10.052580 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 247/499] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:09 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:10.056251 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5e482af2-2194-4802-a38f-b775b161f8ba tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:10.056775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5e482af2-2194-4802-a38f-b775b161f8ba tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:10.062935 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e482af2-2194-4802-a38f-b775b161f8ba tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:10.063373 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e482af2-2194-4802-a38f-b775b161f8ba tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:10.064120 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e482af2-2194-4802-a38f-b775b161f8ba tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:10.064545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e482af2-2194-4802-a38f-b775b161f8ba tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:10.088571 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5e482af2-2194-4802-a38f-b775b161f8ba tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:17:10.177350 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5e482af2-2194-4802-a38f-b775b161f8ba tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 204 len: 0 microversion: 2.1 time: 0.124347 Jul 12 07:17:10.177861 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 253/500] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:17:10 2022] DELETE /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 07:17:10.186337 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3417176b-2205-4838-8d1a-0ceebf7c173b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:10.186932 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3417176b-2205-4838-8d1a-0ceebf7c173b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:10.193234 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3417176b-2205-4838-8d1a-0ceebf7c173b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:10.193676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3417176b-2205-4838-8d1a-0ceebf7c173b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:10.194419 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3417176b-2205-4838-8d1a-0ceebf7c173b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:10.194843 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3417176b-2205-4838-8d1a-0ceebf7c173b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:10.333336 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3417176b-2205-4838-8d1a-0ceebf7c173b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:10.344573 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3417176b-2205-4838-8d1a-0ceebf7c173b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1681 microversion: 2.1 time: 0.161967 Jul 12 07:17:10.345392 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 248/501] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:10 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:17:11.071909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-85cfc5a3-7899-479d-814f-972b3e52e6b6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:11.072931 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-85cfc5a3-7899-479d-814f-972b3e52e6b6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:11.080830 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85cfc5a3-7899-479d-814f-972b3e52e6b6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:11.081307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85cfc5a3-7899-479d-814f-972b3e52e6b6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:11.082066 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85cfc5a3-7899-479d-814f-972b3e52e6b6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:11.082489 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85cfc5a3-7899-479d-814f-972b3e52e6b6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:11.226290 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-85cfc5a3-7899-479d-814f-972b3e52e6b6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:11.235009 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-85cfc5a3-7899-479d-814f-972b3e52e6b6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.168999 Jul 12 07:17:11.235308 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 254/502] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:11 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:11.371560 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2cc2f930-9b24-44c4-b79d-9c3bb3d61a78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:11.372515 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2cc2f930-9b24-44c4-b79d-9c3bb3d61a78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:11.386231 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2cc2f930-9b24-44c4-b79d-9c3bb3d61a78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:11.387563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2cc2f930-9b24-44c4-b79d-9c3bb3d61a78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:11.389197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2cc2f930-9b24-44c4-b79d-9c3bb3d61a78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:11.389936 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2cc2f930-9b24-44c4-b79d-9c3bb3d61a78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:11.523937 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2cc2f930-9b24-44c4-b79d-9c3bb3d61a78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:11.531789 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2cc2f930-9b24-44c4-b79d-9c3bb3d61a78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1681 microversion: 2.1 time: 0.166741 Jul 12 07:17:11.532360 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 249/503] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:11 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:12.253084 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c5731c9-e280-446b-94da-f539acd2c539 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:12.253647 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1c5731c9-e280-446b-94da-f539acd2c539 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:12.260089 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c5731c9-e280-446b-94da-f539acd2c539 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:12.260654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c5731c9-e280-446b-94da-f539acd2c539 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:12.261551 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c5731c9-e280-446b-94da-f539acd2c539 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:12.262079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c5731c9-e280-446b-94da-f539acd2c539 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:12.550160 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-359261b2-59c0-4b28-b451-fd2eafa16912 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:12.550746 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-359261b2-59c0-4b28-b451-fd2eafa16912 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:12.557936 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-359261b2-59c0-4b28-b451-fd2eafa16912 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:12.558399 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-359261b2-59c0-4b28-b451-fd2eafa16912 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:12.559152 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-359261b2-59c0-4b28-b451-fd2eafa16912 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:12.559578 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-359261b2-59c0-4b28-b451-fd2eafa16912 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:12.784085 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1c5731c9-e280-446b-94da-f539acd2c539 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:12.793162 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c5731c9-e280-446b-94da-f539acd2c539 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.545015 Jul 12 07:17:12.793735 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 255/504] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:12 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:12.891096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-359261b2-59c0-4b28-b451-fd2eafa16912 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:12.899396 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-359261b2-59c0-4b28-b451-fd2eafa16912 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1681 microversion: 2.1 time: 0.353455 Jul 12 07:17:12.900051 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 250/505] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:12 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:13.336783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-1c9653cf-6387-43c6-9a0d-0bbe51498401 req-bdd14705-eed4-41f4-aafa-33ad72c4d497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99231ef-ba9f-4294-87ab-e47992b4f001", "name": "network-vif-deleted", "tag": "ad507e7e-5574-4340-9b10-2c7fbbf7fb11"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:13.348054 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-1c9653cf-6387-43c6-9a0d-0bbe51498401 req-bdd14705-eed4-41f4-aafa-33ad72c4d497 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:13.348550 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-1c9653cf-6387-43c6-9a0d-0bbe51498401 req-bdd14705-eed4-41f4-aafa-33ad72c4d497 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:13.362576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-1c9653cf-6387-43c6-9a0d-0bbe51498401 req-bdd14705-eed4-41f4-aafa-33ad72c4d497 service nova] Creating event network-vif-deleted:ad507e7e-5574-4340-9b10-2c7fbbf7fb11 for instance e99231ef-ba9f-4294-87ab-e47992b4f001 on hv-cinder-82549 Jul 12 07:17:13.367460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-1c9653cf-6387-43c6-9a0d-0bbe51498401 req-bdd14705-eed4-41f4-aafa-33ad72c4d497 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034538 Jul 12 07:17:13.368372 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 256/506] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:13.810915 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5710c3e1-729d-473e-af2e-55d6533df137 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:13.811542 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5710c3e1-729d-473e-af2e-55d6533df137 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:13.819229 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5710c3e1-729d-473e-af2e-55d6533df137 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:13.819817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5710c3e1-729d-473e-af2e-55d6533df137 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:13.820606 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5710c3e1-729d-473e-af2e-55d6533df137 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:13.821065 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5710c3e1-729d-473e-af2e-55d6533df137 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:13.919893 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:13.920975 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:13.929968 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:13.930723 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:13.931758 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:13.932439 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:13.967853 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5710c3e1-729d-473e-af2e-55d6533df137 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:13.978125 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5710c3e1-729d-473e-af2e-55d6533df137 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.171098 Jul 12 07:17:13.980766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 251/507] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:13 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:13.984442 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:13.986393 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:13.986893 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lazy-loading 'fault' on Instance uuid e99231ef-ba9f-4294-87ab-e47992b4f001 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:17:14.037587 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:14.045893 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-91bc35f8-2455-47c9-a5ab-60d564451da8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 200 len: 1330 microversion: 2.1 time: 0.131734 Jul 12 07:17:14.046487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 257/508] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:13 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 1330 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:17:14.997695 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6cb93c14-c535-4467-9841-9b2c4aa66e3e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:14.998428 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6cb93c14-c535-4467-9841-9b2c4aa66e3e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:15.006198 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cb93c14-c535-4467-9841-9b2c4aa66e3e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:15.006689 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cb93c14-c535-4467-9841-9b2c4aa66e3e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:15.007526 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cb93c14-c535-4467-9841-9b2c4aa66e3e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:15.007998 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6cb93c14-c535-4467-9841-9b2c4aa66e3e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:15.063848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:15.064516 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:15.070690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:15.071155 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:15.071910 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:15.072336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:15.086379 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 HTTP/1.1 Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:17:15.088051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:17:15.089736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'e99231ef-ba9f-4294-87ab-e47992b4f001'} Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:17:15.090545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:17:15.095807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:15.096856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:17:15.096856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cf8ef1ba-2236-430e-9e53-3ceee96347d2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 404 len: 111 microversion: 2.1 time: 0.029448 Jul 12 07:17:15.096856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 258/509] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:15 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:17:15.099581 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3ed5ebed-b5c0-4972-b6fd-d27180be156a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '.version_select at 0x7f7012b4a1f0>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:15.121597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3ed5ebed-b5c0-4972-b6fd-d27180be156a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2144233527" status: 202 len: 0 microversion: 2.1 time: 0.026442 Jul 12 07:17:15.122436 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 259/510] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 12 07:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2144233527 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 07:17:15.149184 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6cb93c14-c535-4467-9841-9b2c4aa66e3e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:15.157325 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6cb93c14-c535-4467-9841-9b2c4aa66e3e tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.163850 Jul 12 07:17:15.157977 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 252/511] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:14 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:15.794505 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7da0746e-6296-4a51-9fbf-31d6b1110bfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: .version_select at 0x7f70118698b0>, body: {"keypair": {"name": "tempest-keypair-701027465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQ8FYT8gJOqYwjXxTnOgwbBKeWWMB7PVPJD4ZHEJ7AnA47fDINUdQIzUkkBp1Dy9QkZECwse4jCzotMfaUDnr5CvDVa1aVk4GwDI4xo27IHNH4oyo/9rNFKq6TmOFC7BA=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:15.813543 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-7da0746e-6296-4a51-9fbf-31d6b1110bfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for project b52e5f4c43a3469db851b4704f422448. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:17:15.819087 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-7da0746e-6296-4a51-9fbf-31d6b1110bfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for user ef6395fa14b54c43931ffeaab023d97c and project b52e5f4c43a3469db851b4704f422448. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:17:15.842251 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7da0746e-6296-4a51-9fbf-31d6b1110bfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051568 Jul 12 07:17:15.842745 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 260/512] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:17:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:16.175076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-90bfe287-5337-49dd-9783-691e7d12e5fb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:16.175717 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-90bfe287-5337-49dd-9783-691e7d12e5fb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:16.182354 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-90bfe287-5337-49dd-9783-691e7d12e5fb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:16.182804 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-90bfe287-5337-49dd-9783-691e7d12e5fb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:16.183534 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-90bfe287-5337-49dd-9783-691e7d12e5fb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:16.183967 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-90bfe287-5337-49dd-9783-691e7d12e5fb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:16.340982 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-90bfe287-5337-49dd-9783-691e7d12e5fb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:16.349287 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-90bfe287-5337-49dd-9783-691e7d12e5fb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.178123 Jul 12 07:17:16.349867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 253/513] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:16 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:17.194870 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1625560690", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d84884e5-7556-4a7f-b022-9bd7a9e42f24"}], "security_groups": [{"name": "tempest-securitygroup--1307628808"}], "key_name": "tempest-keypair-701027465", "user_data": "}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:17.296808 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] validate_networks() for [('d84884e5-7556-4a7f-b022-9bd7a9e42f24', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:17:17.366393 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f0a674ca-2e1e-4020-a15a-21f6fce9c1c0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:17.367124 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f0a674ca-2e1e-4020-a15a-21f6fce9c1c0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:17.374334 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f0a674ca-2e1e-4020-a15a-21f6fce9c1c0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:17.374972 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f0a674ca-2e1e-4020-a15a-21f6fce9c1c0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:17.375908 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f0a674ca-2e1e-4020-a15a-21f6fce9c1c0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:17.376716 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f0a674ca-2e1e-4020-a15a-21f6fce9c1c0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:17.566140 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f0a674ca-2e1e-4020-a15a-21f6fce9c1c0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:17.574531 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f0a674ca-2e1e-4020-a15a-21f6fce9c1c0 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.212031 Jul 12 07:17:17.575077 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 254/514] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:17 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:17.725598 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:17:17.726013 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:17:17.726511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:17:17.726910 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:17:17.727329 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:17:17.736797 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:17.737281 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:17.738071 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:17.738504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:17.756164 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for project b52e5f4c43a3469db851b4704f422448. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:17:17.760156 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for user ef6395fa14b54c43931ffeaab023d97c and project b52e5f4c43a3469db851b4704f422448. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:17:17.771393 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:17:17.773619 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:17:17.823298 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d60d238b-f098-4da8-9cb2-8866dde492f9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632940 Jul 12 07:17:17.823941 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 261/515] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:17:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:17:17.834354 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c1fb60e9-2525-437d-9cfc-484211d01bd8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:17.835019 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c1fb60e9-2525-437d-9cfc-484211d01bd8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:17.888009 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c1fb60e9-2525-437d-9cfc-484211d01bd8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:17.894854 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c1fb60e9-2525-437d-9cfc-484211d01bd8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1241 microversion: 2.1 time: 0.064421 Jul 12 07:17:17.895431 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 255/516] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:17 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:18.592186 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41ac3093-2db4-4fb6-8f14-fd24eea6a620 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:18.592742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-41ac3093-2db4-4fb6-8f14-fd24eea6a620 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:18.594748 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:18.600911 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41ac3093-2db4-4fb6-8f14-fd24eea6a620 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:18.601367 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41ac3093-2db4-4fb6-8f14-fd24eea6a620 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:18.602126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41ac3093-2db4-4fb6-8f14-fd24eea6a620 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:18.602548 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41ac3093-2db4-4fb6-8f14-fd24eea6a620 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:18.742967 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41ac3093-2db4-4fb6-8f14-fd24eea6a620 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:18.751713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41ac3093-2db4-4fb6-8f14-fd24eea6a620 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.163429 Jul 12 07:17:18.752621 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 262/517] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:18 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:18.912743 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-03b74912-7940-4f0e-ae8b-7ecdc741439b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:18.913355 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-03b74912-7940-4f0e-ae8b-7ecdc741439b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:18.920109 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-03b74912-7940-4f0e-ae8b-7ecdc741439b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:18.920574 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-03b74912-7940-4f0e-ae8b-7ecdc741439b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:18.921367 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-03b74912-7940-4f0e-ae8b-7ecdc741439b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:18.921795 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-03b74912-7940-4f0e-ae8b-7ecdc741439b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:18.991859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-03b74912-7940-4f0e-ae8b-7ecdc741439b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:18.999939 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-03b74912-7940-4f0e-ae8b-7ecdc741439b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1293 microversion: 2.1 time: 0.091557 Jul 12 07:17:19.000720 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 256/518] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:18 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:19.770199 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-26e1b2d8-0ffc-4bba-93ab-52bc941d497a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:19.770888 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-26e1b2d8-0ffc-4bba-93ab-52bc941d497a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:19.777703 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26e1b2d8-0ffc-4bba-93ab-52bc941d497a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:19.778141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26e1b2d8-0ffc-4bba-93ab-52bc941d497a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:19.778965 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26e1b2d8-0ffc-4bba-93ab-52bc941d497a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:19.779367 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26e1b2d8-0ffc-4bba-93ab-52bc941d497a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:19.997439 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-26e1b2d8-0ffc-4bba-93ab-52bc941d497a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:20.007416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-26e1b2d8-0ffc-4bba-93ab-52bc941d497a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.241357 Jul 12 07:17:20.008561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 263/519] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:19 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:20.018813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0eb8d799-634c-4ad0-a039-8d95b1045dfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:20.020022 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0eb8d799-634c-4ad0-a039-8d95b1045dfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:20.027767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0eb8d799-634c-4ad0-a039-8d95b1045dfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:20.028159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0eb8d799-634c-4ad0-a039-8d95b1045dfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:20.029131 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0eb8d799-634c-4ad0-a039-8d95b1045dfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:20.029588 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0eb8d799-634c-4ad0-a039-8d95b1045dfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:20.046877 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:20.246702 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0eb8d799-634c-4ad0-a039-8d95b1045dfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:20.256213 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0eb8d799-634c-4ad0-a039-8d95b1045dfd tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1367 microversion: 2.1 time: 0.242630 Jul 12 07:17:20.257298 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 257/520] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:20 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:20.741639 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-47007a06-da13-452d-b53b-629b5b599bf0 req-b5bc6304-6e97-44e6-b1fa-7fdce3b0b444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f428539a-0743-4d98-889b-0c2e7f7ae5ca", "tag": "017ad56e-17b2-4a1c-bbcb-b39197208153"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:20.752100 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-47007a06-da13-452d-b53b-629b5b599bf0 req-b5bc6304-6e97-44e6-b1fa-7fdce3b0b444 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:20.752982 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-47007a06-da13-452d-b53b-629b5b599bf0 req-b5bc6304-6e97-44e6-b1fa-7fdce3b0b444 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:20.769334 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-47007a06-da13-452d-b53b-629b5b599bf0 req-b5bc6304-6e97-44e6-b1fa-7fdce3b0b444 service nova] Creating event network-changed:017ad56e-17b2-4a1c-bbcb-b39197208153 for instance f428539a-0743-4d98-889b-0c2e7f7ae5ca on hv-cinder-82549 Jul 12 07:17:20.774559 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-47007a06-da13-452d-b53b-629b5b599bf0 req-b5bc6304-6e97-44e6-b1fa-7fdce3b0b444 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039080 Jul 12 07:17:20.775431 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 264/521] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:21.025333 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b7c13935-fc19-4dde-810d-4aaca671ee6f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:21.025933 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b7c13935-fc19-4dde-810d-4aaca671ee6f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:21.032715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7c13935-fc19-4dde-810d-4aaca671ee6f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:21.033269 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7c13935-fc19-4dde-810d-4aaca671ee6f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:21.034040 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7c13935-fc19-4dde-810d-4aaca671ee6f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:21.034455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7c13935-fc19-4dde-810d-4aaca671ee6f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:21.242050 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b7c13935-fc19-4dde-810d-4aaca671ee6f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:21.251947 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b7c13935-fc19-4dde-810d-4aaca671ee6f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.230130 Jul 12 07:17:21.252459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 258/522] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:21 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:21.274280 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b05a0314-48fc-4028-b8d4-a0a1aaa216db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:21.274960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b05a0314-48fc-4028-b8d4-a0a1aaa216db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:21.281569 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b05a0314-48fc-4028-b8d4-a0a1aaa216db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:21.282014 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b05a0314-48fc-4028-b8d4-a0a1aaa216db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:21.282837 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b05a0314-48fc-4028-b8d4-a0a1aaa216db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:21.283364 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b05a0314-48fc-4028-b8d4-a0a1aaa216db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:21.414584 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b05a0314-48fc-4028-b8d4-a0a1aaa216db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:21.422501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b05a0314-48fc-4028-b8d4-a0a1aaa216db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1367 microversion: 2.1 time: 0.152534 Jul 12 07:17:21.423108 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 265/523] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:21 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:21.725507 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e2d79c1f-91af-4b86-afc1-3e449fb6dd5d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:21.726305 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e2d79c1f-91af-4b86-afc1-3e449fb6dd5d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:21.736579 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1f-91af-4b86-afc1-3e449fb6dd5d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:21.737002 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1f-91af-4b86-afc1-3e449fb6dd5d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:21.737776 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1f-91af-4b86-afc1-3e449fb6dd5d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:21.738201 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e2d79c1f-91af-4b86-afc1-3e449fb6dd5d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:21.767046 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e2d79c1f-91af-4b86-afc1-3e449fb6dd5d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments/25afcd9a-b696-4613-b444-172dde3050d7" status: 200 len: 194 microversion: 2.20 time: 0.048198 Jul 12 07:17:21.767680 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 259/524] 10.222.0.25 () {60 vars in 1453 bytes} [Tue Jul 12 07:17:21 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments/25afcd9a-b696-4613-b444-172dde3050d7 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:17:21.843379 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-49562390-662b-496c-a97a-751b9f73f2ac tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:21.843888 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-49562390-662b-496c-a97a-751b9f73f2ac tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:21.850376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49562390-662b-496c-a97a-751b9f73f2ac tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:21.850818 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49562390-662b-496c-a97a-751b9f73f2ac tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:21.851568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49562390-662b-496c-a97a-751b9f73f2ac tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:21.851994 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49562390-662b-496c-a97a-751b9f73f2ac tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:21.977756 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-49562390-662b-496c-a97a-751b9f73f2ac tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lazy-loading 'services' on Instance uuid e1dba59c-e816-486d-9296-9fcd6e5a51ff {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:17:22.098702 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-49562390-662b-496c-a97a-751b9f73f2ac tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments/25afcd9a-b696-4613-b444-172dde3050d7" status: 202 len: 0 microversion: 2.20 time: 0.259147 Jul 12 07:17:22.099290 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 266/525] 10.222.0.25 () {60 vars in 1456 bytes} [Tue Jul 12 07:17:21 2022] DELETE /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments/25afcd9a-b696-4613-b444-172dde3050d7 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:17:22.107741 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5479faca-0655-4f60-af84-ac0543bca1c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:22.108731 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5479faca-0655-4f60-af84-ac0543bca1c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:22.115565 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5479faca-0655-4f60-af84-ac0543bca1c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:22.116005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5479faca-0655-4f60-af84-ac0543bca1c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:22.116862 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5479faca-0655-4f60-af84-ac0543bca1c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:22.117337 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5479faca-0655-4f60-af84-ac0543bca1c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:22.146458 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5479faca-0655-4f60-af84-ac0543bca1c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042697 Jul 12 07:17:22.146985 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 260/526] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 12 07:17:22 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:17:22.272546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8fb0e701-b6de-4921-9b03-04dda878ee75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:22.273374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8fb0e701-b6de-4921-9b03-04dda878ee75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:22.281344 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fb0e701-b6de-4921-9b03-04dda878ee75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:22.281865 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fb0e701-b6de-4921-9b03-04dda878ee75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:22.282937 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fb0e701-b6de-4921-9b03-04dda878ee75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:22.283486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fb0e701-b6de-4921-9b03-04dda878ee75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:22.445089 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7014389d-0fc3-4d4f-8329-9e6d834c5e8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:22.445710 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7014389d-0fc3-4d4f-8329-9e6d834c5e8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:22.452108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7014389d-0fc3-4d4f-8329-9e6d834c5e8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:22.452528 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7014389d-0fc3-4d4f-8329-9e6d834c5e8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:22.453329 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7014389d-0fc3-4d4f-8329-9e6d834c5e8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:22.453736 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7014389d-0fc3-4d4f-8329-9e6d834c5e8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:22.478119 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8fb0e701-b6de-4921-9b03-04dda878ee75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:22.487507 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8fb0e701-b6de-4921-9b03-04dda878ee75 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.220574 Jul 12 07:17:22.488173 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 267/527] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:22 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:22.633809 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7014389d-0fc3-4d4f-8329-9e6d834c5e8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:22.644958 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7014389d-0fc3-4d4f-8329-9e6d834c5e8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1367 microversion: 2.1 time: 0.203703 Jul 12 07:17:22.645609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 261/528] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:22 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:23.158694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bae36dd8-db3d-465d-b584-1b221907941e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:23.160949 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bae36dd8-db3d-465d-b584-1b221907941e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:23.168588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bae36dd8-db3d-465d-b584-1b221907941e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:23.169003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bae36dd8-db3d-465d-b584-1b221907941e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:23.169960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bae36dd8-db3d-465d-b584-1b221907941e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:23.170382 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bae36dd8-db3d-465d-b584-1b221907941e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:23.206306 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bae36dd8-db3d-465d-b584-1b221907941e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051532 Jul 12 07:17:23.206886 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 268/529] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 12 07:17:23 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:17:23.505730 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dcd37742-edef-472f-a340-aef19a3913d6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:23.506326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dcd37742-edef-472f-a340-aef19a3913d6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:23.513354 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dcd37742-edef-472f-a340-aef19a3913d6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:23.513801 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dcd37742-edef-472f-a340-aef19a3913d6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:23.514609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dcd37742-edef-472f-a340-aef19a3913d6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:23.515032 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dcd37742-edef-472f-a340-aef19a3913d6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:23.662540 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f69b01d-7355-4c55-8593-03459af06fb3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:23.663119 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2f69b01d-7355-4c55-8593-03459af06fb3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:23.669828 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f69b01d-7355-4c55-8593-03459af06fb3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:23.670265 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f69b01d-7355-4c55-8593-03459af06fb3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:23.671022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f69b01d-7355-4c55-8593-03459af06fb3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:23.671455 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f69b01d-7355-4c55-8593-03459af06fb3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:23.988170 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dcd37742-edef-472f-a340-aef19a3913d6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:23.992371 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2f69b01d-7355-4c55-8593-03459af06fb3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:23.995279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:23.996882 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dcd37742-edef-472f-a340-aef19a3913d6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.495280 Jul 12 07:17:23.999975 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 262/530] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:23 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:24.001976 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2f69b01d-7355-4c55-8593-03459af06fb3 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1367 microversion: 2.1 time: 0.343942 Jul 12 07:17:24.002711 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 269/531] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:23 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:24.218912 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4985a4d8-b7fc-44c0-9d36-5596610040c1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:24.220203 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4985a4d8-b7fc-44c0-9d36-5596610040c1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:24.227009 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4985a4d8-b7fc-44c0-9d36-5596610040c1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:24.227455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4985a4d8-b7fc-44c0-9d36-5596610040c1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:24.228214 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4985a4d8-b7fc-44c0-9d36-5596610040c1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:24.228827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4985a4d8-b7fc-44c0-9d36-5596610040c1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:24.267266 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4985a4d8-b7fc-44c0-9d36-5596610040c1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052160 Jul 12 07:17:24.267909 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 263/532] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 12 07:17:24 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:24.339162 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e3eb1298-8998-4363-b1e8-dfb92543890c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:24.339694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3eb1298-8998-4363-b1e8-dfb92543890c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:24.347240 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3eb1298-8998-4363-b1e8-dfb92543890c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:24.347742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3eb1298-8998-4363-b1e8-dfb92543890c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:24.348500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3eb1298-8998-4363-b1e8-dfb92543890c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:24.348926 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3eb1298-8998-4363-b1e8-dfb92543890c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:24.374811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3eb1298-8998-4363-b1e8-dfb92543890c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:17:24.455842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e3eb1298-8998-4363-b1e8-dfb92543890c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 204 len: 0 microversion: 2.20 time: 0.120233 Jul 12 07:17:24.456466 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 270/533] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 12 07:17:24 2022] DELETE /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 07:17:24.464872 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:24.465624 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:24.472228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:24.472671 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:24.473520 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:24.473984 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:24.606343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:24.614987 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:24.616563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:24.618174 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f7a03151-0a3a-4435-895e-73922d962c3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.156911 Jul 12 07:17:24.618804 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 264/534] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:24 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:25.022199 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-24c55322-524a-43f5-9956-1ea7a52b8d4a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:25.022971 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-24c55322-524a-43f5-9956-1ea7a52b8d4a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:25.025769 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-20d3e9b3-37ef-4ba4-871e-8731c31c38db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:25.026679 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-20d3e9b3-37ef-4ba4-871e-8731c31c38db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:25.035251 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20d3e9b3-37ef-4ba4-871e-8731c31c38db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:25.035693 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20d3e9b3-37ef-4ba4-871e-8731c31c38db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:25.036818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20d3e9b3-37ef-4ba4-871e-8731c31c38db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:25.036958 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24c55322-524a-43f5-9956-1ea7a52b8d4a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:25.037305 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-20d3e9b3-37ef-4ba4-871e-8731c31c38db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:25.037445 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24c55322-524a-43f5-9956-1ea7a52b8d4a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:25.038108 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24c55322-524a-43f5-9956-1ea7a52b8d4a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:25.038524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24c55322-524a-43f5-9956-1ea7a52b8d4a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:25.227610 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-20d3e9b3-37ef-4ba4-871e-8731c31c38db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:25.231843 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-24c55322-524a-43f5-9956-1ea7a52b8d4a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:25.238009 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-20d3e9b3-37ef-4ba4-871e-8731c31c38db tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1367 microversion: 2.1 time: 0.216713 Jul 12 07:17:25.238908 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 265/535] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:25 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:25.242388 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-24c55322-524a-43f5-9956-1ea7a52b8d4a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.227542 Jul 12 07:17:25.243220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 271/536] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:25 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:25.642707 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:25.643619 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:25.652089 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:25.652652 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:25.653674 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:25.654218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:25.796690 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:25.808806 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:25.810829 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:25.812324 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c4259dd5-b0d6-4899-9128-e65463785c61 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.175068 Jul 12 07:17:25.813028 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 266/537] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:25 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:26.200490 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-b35f1f3f-a270-4027-ae8b-2f45283b8d32 req-c85bdfbb-ad73-407c-96be-708c7d916ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f428539a-0743-4d98-889b-0c2e7f7ae5ca", "name": "network-vif-plugged", "status": "completed", "tag": "017ad56e-17b2-4a1c-bbcb-b39197208153"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:26.209096 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b35f1f3f-a270-4027-ae8b-2f45283b8d32 req-c85bdfbb-ad73-407c-96be-708c7d916ffe service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:26.209450 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b35f1f3f-a270-4027-ae8b-2f45283b8d32 req-c85bdfbb-ad73-407c-96be-708c7d916ffe service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:26.220788 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-b35f1f3f-a270-4027-ae8b-2f45283b8d32 req-c85bdfbb-ad73-407c-96be-708c7d916ffe service nova] Creating event network-vif-plugged:017ad56e-17b2-4a1c-bbcb-b39197208153 for instance f428539a-0743-4d98-889b-0c2e7f7ae5ca on hv-cinder-82549 Jul 12 07:17:26.225724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-b35f1f3f-a270-4027-ae8b-2f45283b8d32 req-c85bdfbb-ad73-407c-96be-708c7d916ffe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029016 Jul 12 07:17:26.226305 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 272/538] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:26.254422 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6c54a419-ee77-4b13-bc04-eb588ab3dd04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:26.255280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6c54a419-ee77-4b13-bc04-eb588ab3dd04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:26.260753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-42ffc91f-9499-4323-81cd-df0ecea6906b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:26.261579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-42ffc91f-9499-4323-81cd-df0ecea6906b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:26.261756 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c54a419-ee77-4b13-bc04-eb588ab3dd04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:26.262010 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c54a419-ee77-4b13-bc04-eb588ab3dd04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:26.262802 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c54a419-ee77-4b13-bc04-eb588ab3dd04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:26.263796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6c54a419-ee77-4b13-bc04-eb588ab3dd04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:26.268812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42ffc91f-9499-4323-81cd-df0ecea6906b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:26.269460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42ffc91f-9499-4323-81cd-df0ecea6906b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:26.270395 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42ffc91f-9499-4323-81cd-df0ecea6906b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:26.270819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42ffc91f-9499-4323-81cd-df0ecea6906b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:26.459389 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6c54a419-ee77-4b13-bc04-eb588ab3dd04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:26.466160 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-42ffc91f-9499-4323-81cd-df0ecea6906b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:26.467429 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6c54a419-ee77-4b13-bc04-eb588ab3dd04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1367 microversion: 2.1 time: 0.217016 Jul 12 07:17:26.467986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 267/539] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:26 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:26.475411 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-42ffc91f-9499-4323-81cd-df0ecea6906b tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.218889 Jul 12 07:17:26.476059 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 273/540] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:26 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:26.833719 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:26.834368 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:26.841202 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:26.841653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:26.842545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:26.843015 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:27.033903 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:27.042886 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:27.044369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:27.045552 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f8be5bd2-ba2a-457d-acbf-24f6c2f19573 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1726 microversion: 2.20 time: 0.216852 Jul 12 07:17:27.046136 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 268/541] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:26 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:27.484454 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e6e874e3-6dc2-4a5f-b30d-e57a0cd57262 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:27.485087 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e6e874e3-6dc2-4a5f-b30d-e57a0cd57262 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:27.491484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6e874e3-6dc2-4a5f-b30d-e57a0cd57262 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:27.491708 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ef2d1a6a-cb55-412c-9ad0-c1a244960139 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:27.491891 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6e874e3-6dc2-4a5f-b30d-e57a0cd57262 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:27.492332 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ef2d1a6a-cb55-412c-9ad0-c1a244960139 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:27.492839 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6e874e3-6dc2-4a5f-b30d-e57a0cd57262 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:27.493440 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6e874e3-6dc2-4a5f-b30d-e57a0cd57262 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:27.498989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ef2d1a6a-cb55-412c-9ad0-c1a244960139 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:27.499425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ef2d1a6a-cb55-412c-9ad0-c1a244960139 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:27.500181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ef2d1a6a-cb55-412c-9ad0-c1a244960139 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:27.500583 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ef2d1a6a-cb55-412c-9ad0-c1a244960139 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:27.745983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:27.769799 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=10 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:27.810617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e6e874e3-6dc2-4a5f-b30d-e57a0cd57262 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:27.818764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e6e874e3-6dc2-4a5f-b30d-e57a0cd57262 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1367 microversion: 2.1 time: 0.338207 Jul 12 07:17:27.819685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 274/542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:27 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:27.831121 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ef2d1a6a-cb55-412c-9ad0-c1a244960139 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:27.839807 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ef2d1a6a-cb55-412c-9ad0-c1a244960139 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1736 microversion: 2.1 time: 0.352046 Jul 12 07:17:27.840455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 269/543] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:27 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1736 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:28.064547 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:28.065200 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:28.066551 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-c9f147bd-6024-403d-8e01-ab2646848930 req-5bd4f11b-b2db-4c39-adf0-e0719c657caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dba59c-e816-486d-9296-9fcd6e5a51ff", "name": "network-vif-deleted", "tag": "e091627f-3767-4ff2-9414-c9935125f0fb"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:28.071316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:28.072127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:28.073076 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:28.073656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:28.074163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:28.077252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c9f147bd-6024-403d-8e01-ab2646848930 req-5bd4f11b-b2db-4c39-adf0-e0719c657caf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:28.077824 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c9f147bd-6024-403d-8e01-ab2646848930 req-5bd4f11b-b2db-4c39-adf0-e0719c657caf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:28.090279 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-c9f147bd-6024-403d-8e01-ab2646848930 req-5bd4f11b-b2db-4c39-adf0-e0719c657caf service nova] Creating event network-vif-deleted:e091627f-3767-4ff2-9414-c9935125f0fb for instance e1dba59c-e816-486d-9296-9fcd6e5a51ff on hv-cinder-82549 Jul 12 07:17:28.097938 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-c9f147bd-6024-403d-8e01-ab2646848930 req-5bd4f11b-b2db-4c39-adf0-e0719c657caf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034021 Jul 12 07:17:28.098674 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 270/544] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:28.156814 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:28.168261 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:28.170090 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:28.171440 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0101f479-2fc0-46a4-ad53-85cbd1a90189 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1658 microversion: 2.20 time: 0.111248 Jul 12 07:17:28.171995 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 275/545] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:28 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1658 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:28.836646 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a0ff319b-52d3-47c0-9eaa-bf2c737abfe0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:28.837372 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a0ff319b-52d3-47c0-9eaa-bf2c737abfe0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:28.844332 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a0ff319b-52d3-47c0-9eaa-bf2c737abfe0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:28.845273 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a0ff319b-52d3-47c0-9eaa-bf2c737abfe0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:28.846041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a0ff319b-52d3-47c0-9eaa-bf2c737abfe0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:28.846469 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a0ff319b-52d3-47c0-9eaa-bf2c737abfe0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:28.856801 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d518acf-6511-403a-af5f-eafb910bd532 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:28.857408 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d518acf-6511-403a-af5f-eafb910bd532 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:28.864104 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d518acf-6511-403a-af5f-eafb910bd532 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:28.864547 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d518acf-6511-403a-af5f-eafb910bd532 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:28.865319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d518acf-6511-403a-af5f-eafb910bd532 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:28.865963 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d518acf-6511-403a-af5f-eafb910bd532 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.061897 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d518acf-6511-403a-af5f-eafb910bd532 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:29.066688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a0ff319b-52d3-47c0-9eaa-bf2c737abfe0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:29.071252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d518acf-6511-403a-af5f-eafb910bd532 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1716 microversion: 2.1 time: 0.218250 Jul 12 07:17:29.071980 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 276/546] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:28 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1716 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:29.077452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a0ff319b-52d3-47c0-9eaa-bf2c737abfe0 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1367 microversion: 2.1 time: 0.245029 Jul 12 07:17:29.078046 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 271/547] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:28 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:29.186952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:29.187405 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:29.191401 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:29.191922 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:29.193753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:29.194261 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.195224 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:29.195723 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.199236 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:29.199670 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.200612 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:29.201073 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.230776 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:29.231218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.231658 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lazy-loading 'fault' on Instance uuid e1dba59c-e816-486d-9296-9fcd6e5a51ff {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:17:29.275920 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:29.277835 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] HTTP exception thrown: Cannot 'detach_volume' instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 while it is in vm_state rescued Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Request method failure captured: Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: DELETE /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments/fbc8b6ba-e0b9-445a-8f72-f3c48ef88029 HTTP/1.1 Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8LNzVtfwpWAvhiG2VP0p95W_cw9L67Ras80UJ2NEefm-WsWmJD5azfokIEUQefIyUkbJ_7V7fsLEiDZGmTCEF0IneZIGogc__7IY7HGtn2qzESHPoii1lhONc87MT1rgwRsXngi2y59qxPUzaz-EkboDdqOQsCgr6lARNC3J29QuM Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:17:29.279429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02510f7812444c59bec582ff1127aa13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02510f7812444c59bec582ff1127aa13"}]}] Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 7093cc7cf9d1472db33b31e5f98a5141 Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:17:29.281102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Cannot 'detach_volume' instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 while it is in vm_state rescued Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'server_id': '59be899b-3595-4b0a-9e4c-969db0bb9c77', 'id': 'fbc8b6ba-e0b9-445a-8f72-f3c48ef88029'} Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:17:29.281842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 while it is in vm_state rescued Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 while it is in vm_state rescued Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:17:29.283462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Returning 409 to user: Cannot 'detach_volume' instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 while it is in vm_state rescued {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:17:29.285030 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-903e8fb9-1bbf-4041-a74f-72ad58ae57e7 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments/fbc8b6ba-e0b9-445a-8f72-f3c48ef88029" status: 409 len: 152 microversion: 2.1 time: 0.098142 Jul 12 07:17:29.285199 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:29.285321 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 277/548] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:17:29 2022] DELETE /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments/fbc8b6ba-e0b9-445a-8f72-f3c48ef88029 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 07:17:29.286462 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:29.287581 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-251e91ce-0047-4ea2-ad7b-02b52a0d1d3b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 200 len: 1372 microversion: 2.20 time: 0.100600 Jul 12 07:17:29.288321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 272/549] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:29 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:29.289794 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d760f218-8ca4-492f-90e5-05b81a186268 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:29.290308 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d760f218-8ca4-492f-90e5-05b81a186268 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:29.296266 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d760f218-8ca4-492f-90e5-05b81a186268 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:29.296704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d760f218-8ca4-492f-90e5-05b81a186268 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.297478 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d760f218-8ca4-492f-90e5-05b81a186268 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:29.298023 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d760f218-8ca4-492f-90e5-05b81a186268 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.366974 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d760f218-8ca4-492f-90e5-05b81a186268 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "POST /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/action" status: 202 len: 0 microversion: 2.1 time: 0.080811 Jul 12 07:17:29.367539 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 278/550] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:17:29 2022] POST /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:17:29.376062 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7a112ba6-1b48-4aa4-b593-8da9c8a9adb8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:29.376661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7a112ba6-1b48-4aa4-b593-8da9c8a9adb8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:29.382805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a112ba6-1b48-4aa4-b593-8da9c8a9adb8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:29.383243 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a112ba6-1b48-4aa4-b593-8da9c8a9adb8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.383976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a112ba6-1b48-4aa4-b593-8da9c8a9adb8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:29.384398 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a112ba6-1b48-4aa4-b593-8da9c8a9adb8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:29.524963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7a112ba6-1b48-4aa4-b593-8da9c8a9adb8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:29.533942 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7a112ba6-1b48-4aa4-b593-8da9c8a9adb8 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1724 microversion: 2.1 time: 0.161803 Jul 12 07:17:29.534517 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 273/551] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:29 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:30.095510 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2dcb3ac1-d215-4352-a941-e6bd13b926e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:30.096364 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2dcb3ac1-d215-4352-a941-e6bd13b926e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:30.103178 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2dcb3ac1-d215-4352-a941-e6bd13b926e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:30.103617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2dcb3ac1-d215-4352-a941-e6bd13b926e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:30.104363 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2dcb3ac1-d215-4352-a941-e6bd13b926e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:30.104789 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2dcb3ac1-d215-4352-a941-e6bd13b926e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:30.306162 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:30.306788 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:30.313812 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:30.314250 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:30.315034 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:30.315458 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:30.322979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2dcb3ac1-d215-4352-a941-e6bd13b926e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:30.329182 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] HTTP exception thrown: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:17:30.331000 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2dcb3ac1-d215-4352-a941-e6bd13b926e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1557 microversion: 2.1 time: 0.240002 Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Request method failure captured: Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff HTTP/1.1 Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8AEstPUYUAEPScrGy9oQr7FTt8tNmENsfWplBlyjF4vMNqpY7Z1frG3gEsDEzFRjm8e1X5VxAmYFZku4ZaZc-8o1Ij2GFrshboEUf5KCjQzbXNaIIzNWdO6k4-51-W_0wQWdQtFqjAFWDS7TRmNwbZguMpkEntiMBpDJcuh_D4hpU Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:17:30.331144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ed408b23e4c48a5861e542d02e0ee64"}]}] Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 53278c1c534344978ca40d7e2313c02c Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:17:30.332825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'e1dba59c-e816-486d-9296-9fcd6e5a51ff'} Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:17:30.333648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:17:30.334827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:30.337202 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Returning 404 to user: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:17:30.337202 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-86fc18fe-8300-4d34-95af-6cf13ae546fd tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 404 len: 111 microversion: 2.20 time: 0.030368 Jul 12 07:17:30.337202 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 274/552] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:30 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:17:30.337635 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 279/553] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:30 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1557 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:30.344101 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a73f332a-c2c8-4ebf-9bf8-91cfca952689 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '.version_select at 0x7f70117cb1f0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:30.347010 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fca57b78-3b5d-40b1-a246-f34b1cef18d1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:30.348317 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fca57b78-3b5d-40b1-a246-f34b1cef18d1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:30.354519 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fca57b78-3b5d-40b1-a246-f34b1cef18d1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:30.354961 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fca57b78-3b5d-40b1-a246-f34b1cef18d1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:30.356244 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fca57b78-3b5d-40b1-a246-f34b1cef18d1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:30.356862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fca57b78-3b5d-40b1-a246-f34b1cef18d1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:30.365485 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a73f332a-c2c8-4ebf-9bf8-91cfca952689 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350638431" status: 204 len: 0 microversion: 2.20 time: 0.025331 Jul 12 07:17:30.370169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 275/554] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 12 07:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350638431 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 07:17:30.443274 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fca57b78-3b5d-40b1-a246-f34b1cef18d1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100210 Jul 12 07:17:30.443914 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 280/555] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 07:17:30 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:30.553123 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c6318591-1efa-4adf-a976-0984ecb81d92 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:30.555380 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c6318591-1efa-4adf-a976-0984ecb81d92 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:30.562980 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c6318591-1efa-4adf-a976-0984ecb81d92 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:30.563416 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c6318591-1efa-4adf-a976-0984ecb81d92 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:30.564738 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c6318591-1efa-4adf-a976-0984ecb81d92 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:30.565285 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c6318591-1efa-4adf-a976-0984ecb81d92 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:30.568401 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:30.805329 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c6318591-1efa-4adf-a976-0984ecb81d92 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:30.814182 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c6318591-1efa-4adf-a976-0984ecb81d92 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1724 microversion: 2.1 time: 0.264840 Jul 12 07:17:30.814673 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 276/556] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:30 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:31.056983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e1a2bbe-8081-4daf-aa43-45e6fad6ea45 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'create', calling method: .version_select at 0x7f7011748b80>, body: {"keypair": {"name": "tempest-keypair-1453589091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIadmtnwhaICOGG5WFjcaB2R2B4nHr/gUbuAvlzBykqmkBCb+yK6+UGf0TfYFjC7VT9Y20HGli5i2e2CX2M5hhIggiEU/bmE05T1/s8khN0L4y6darCg20sb4AhleU7drQ=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:31.073609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-2e1a2bbe-8081-4daf-aa43-45e6fad6ea45 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Getting quotas for project 2ed408b23e4c48a5861e542d02e0ee64. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:17:31.078354 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-2e1a2bbe-8081-4daf-aa43-45e6fad6ea45 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Getting quotas for user 53278c1c534344978ca40d7e2313c02c and project 2ed408b23e4c48a5861e542d02e0ee64. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:17:31.103720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e1a2bbe-8081-4daf-aa43-45e6fad6ea45 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052374 Jul 12 07:17:31.104471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 281/557] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 12 07:17:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 12 07:17:31.768486 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-5f65093f-1993-4c56-b9b5-213b7a8a1650 req-74b2e98d-cf4b-4235-92f9-07f33dbd1f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f428539a-0743-4d98-889b-0c2e7f7ae5ca", "tag": "017ad56e-17b2-4a1c-bbcb-b39197208153"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:31.777875 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5f65093f-1993-4c56-b9b5-213b7a8a1650 req-74b2e98d-cf4b-4235-92f9-07f33dbd1f5c service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:31.778314 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5f65093f-1993-4c56-b9b5-213b7a8a1650 req-74b2e98d-cf4b-4235-92f9-07f33dbd1f5c service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:31.790704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-5f65093f-1993-4c56-b9b5-213b7a8a1650 req-74b2e98d-cf4b-4235-92f9-07f33dbd1f5c service nova] Creating event network-changed:017ad56e-17b2-4a1c-bbcb-b39197208153 for instance f428539a-0743-4d98-889b-0c2e7f7ae5ca on hv-cinder-82549 Jul 12 07:17:31.795921 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-5f65093f-1993-4c56-b9b5-213b7a8a1650 req-74b2e98d-cf4b-4235-92f9-07f33dbd1f5c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031108 Jul 12 07:17:31.796735 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 277/558] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:31.832002 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f39a76e4-0ebd-42eb-a7b6-5f17b783d307 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:31.832931 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f39a76e4-0ebd-42eb-a7b6-5f17b783d307 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:31.839298 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f39a76e4-0ebd-42eb-a7b6-5f17b783d307 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:31.840059 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f39a76e4-0ebd-42eb-a7b6-5f17b783d307 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:31.841087 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f39a76e4-0ebd-42eb-a7b6-5f17b783d307 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:31.841734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f39a76e4-0ebd-42eb-a7b6-5f17b783d307 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:32.031952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f39a76e4-0ebd-42eb-a7b6-5f17b783d307 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:32.044197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f39a76e4-0ebd-42eb-a7b6-5f17b783d307 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1724 microversion: 2.1 time: 0.214249 Jul 12 07:17:32.045109 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 282/559] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:31 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:32.449700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1043498119", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2f0b23c-5195-4564-a429-b8507bb32624"}], "security_groups": [{"name": "tempest-securitygroup--1708387865"}], "key_name": "tempest-keypair-1453589091", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:32.561096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] validate_networks() for [('e2f0b23c-5195-4564-a429-b8507bb32624', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:17:33.062154 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a4aec10-0c87-40b3-aafd-13f65d89ccc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:33.062729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a4aec10-0c87-40b3-aafd-13f65d89ccc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:33.069336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a4aec10-0c87-40b3-aafd-13f65d89ccc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:33.069778 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a4aec10-0c87-40b3-aafd-13f65d89ccc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:33.070535 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a4aec10-0c87-40b3-aafd-13f65d89ccc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:33.070956 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a4aec10-0c87-40b3-aafd-13f65d89ccc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:33.152658 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:17:33.153171 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:17:33.153563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:17:33.153971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:17:33.154383 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:17:33.164755 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:33.165223 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:33.166018 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:33.166877 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:33.184733 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Getting quotas for project 2ed408b23e4c48a5861e542d02e0ee64. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:17:33.189666 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Getting quotas for user 53278c1c534344978ca40d7e2313c02c and project 2ed408b23e4c48a5861e542d02e0ee64. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:17:33.201568 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:17:33.203969 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:17:33.252919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a69974ac-95fe-408d-a7f2-4f40ae78de4a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.807889 Jul 12 07:17:33.253707 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 278/560] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 12 07:17:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 07:17:33.263686 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e31fbc47-244c-4fc6-ad5a-e87ec1e2edf2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:33.264834 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e31fbc47-244c-4fc6-ad5a-e87ec1e2edf2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:33.271963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:33.311785 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a4aec10-0c87-40b3-aafd-13f65d89ccc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:33.320429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a4aec10-0c87-40b3-aafd-13f65d89ccc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1730 microversion: 2.1 time: 0.262267 Jul 12 07:17:33.320997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 283/561] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:33 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:33.338722 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e31fbc47-244c-4fc6-ad5a-e87ec1e2edf2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:33.344141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ccc6c5bf-4cf4-4e4b-930b-48b542e04352 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:33.344978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ccc6c5bf-4cf4-4e4b-930b-48b542e04352 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:33.353005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e31fbc47-244c-4fc6-ad5a-e87ec1e2edf2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:33.353540 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccc6c5bf-4cf4-4e4b-930b-48b542e04352 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:33.354008 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccc6c5bf-4cf4-4e4b-930b-48b542e04352 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:33.354841 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccc6c5bf-4cf4-4e4b-930b-48b542e04352 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:33.355129 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e31fbc47-244c-4fc6-ad5a-e87ec1e2edf2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:33.355252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccc6c5bf-4cf4-4e4b-930b-48b542e04352 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:33.356330 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e31fbc47-244c-4fc6-ad5a-e87ec1e2edf2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1282 microversion: 2.20 time: 0.096667 Jul 12 07:17:33.357321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 279/562] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:33 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:33.448751 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ccc6c5bf-4cf4-4e4b-930b-48b542e04352 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114673 Jul 12 07:17:33.453210 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 284/563] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 07:17:33 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:17:34.376071 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:34.376681 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:34.386617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:34.387083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:34.387877 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:34.388312 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:34.488743 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:34.498620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:34.500746 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:34.502646 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0ffdfae2-f0e8-4912-a150-44267722c57d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1342 microversion: 2.20 time: 0.131071 Jul 12 07:17:34.504169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 280/564] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:34 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1342 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:34.628512 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-067987f9-a38c-475a-8b51-066581de6f38 req-284ff73d-07de-423d-94b7-494eb6ed6548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be899b-3595-4b0a-9e4c-969db0bb9c77", "tag": "713c4298-d251-4d26-895d-e7b0b522105b"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:34.638461 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-067987f9-a38c-475a-8b51-066581de6f38 req-284ff73d-07de-423d-94b7-494eb6ed6548 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:34.638894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-067987f9-a38c-475a-8b51-066581de6f38 req-284ff73d-07de-423d-94b7-494eb6ed6548 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:34.651872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-067987f9-a38c-475a-8b51-066581de6f38 req-284ff73d-07de-423d-94b7-494eb6ed6548 service nova] Creating event network-changed:713c4298-d251-4d26-895d-e7b0b522105b for instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 on hv-cinder-82549 Jul 12 07:17:34.657176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-067987f9-a38c-475a-8b51-066581de6f38 req-284ff73d-07de-423d-94b7-494eb6ed6548 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040524 Jul 12 07:17:34.657904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 285/565] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:35.521197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:35.521914 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:35.530264 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:35.530907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:35.532007 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:35.532907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:36.046073 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:36.055169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:36.056761 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:36.057975 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9646e229-332a-42e8-bc61-3c687a5b810a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1408 microversion: 2.20 time: 0.540956 Jul 12 07:17:36.058611 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 281/566] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:35 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1408 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:36.669503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-a5186b83-253c-4955-9d94-42dcc2d1d917 req-bf61de85-671c-4b6a-bdc3-c572bae6bc68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db8a7f04-501d-4547-b7ca-9e19f7d59c32", "tag": "3564b5da-8b1e-491d-b0b1-502090eeb718"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:36.675417 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-26c76d18-a77f-4e25-b846-b4a87117c26c req-38fe56cd-1aa9-488e-bd4d-943a97e8b64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59be899b-3595-4b0a-9e4c-969db0bb9c77", "tag": "713c4298-d251-4d26-895d-e7b0b522105b"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:36.679699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-a5186b83-253c-4955-9d94-42dcc2d1d917 req-bf61de85-671c-4b6a-bdc3-c572bae6bc68 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:36.680335 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-a5186b83-253c-4955-9d94-42dcc2d1d917 req-bf61de85-671c-4b6a-bdc3-c572bae6bc68 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:36.689776 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-26c76d18-a77f-4e25-b846-b4a87117c26c req-38fe56cd-1aa9-488e-bd4d-943a97e8b64d service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:36.690529 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-26c76d18-a77f-4e25-b846-b4a87117c26c req-38fe56cd-1aa9-488e-bd4d-943a97e8b64d service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:36.695827 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-a5186b83-253c-4955-9d94-42dcc2d1d917 req-bf61de85-671c-4b6a-bdc3-c572bae6bc68 service nova] Creating event network-changed:3564b5da-8b1e-491d-b0b1-502090eeb718 for instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 on hv-cinder-82549 Jul 12 07:17:36.700552 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-a5186b83-253c-4955-9d94-42dcc2d1d917 req-bf61de85-671c-4b6a-bdc3-c572bae6bc68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035421 Jul 12 07:17:36.701466 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 286/567] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:36.713441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-26c76d18-a77f-4e25-b846-b4a87117c26c req-38fe56cd-1aa9-488e-bd4d-943a97e8b64d service nova] Creating event network-changed:713c4298-d251-4d26-895d-e7b0b522105b for instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 on hv-cinder-82549 Jul 12 07:17:36.720150 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-26c76d18-a77f-4e25-b846-b4a87117c26c req-38fe56cd-1aa9-488e-bd4d-943a97e8b64d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049863 Jul 12 07:17:36.721493 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 282/568] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:37.076556 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:37.077279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:37.084335 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:37.084784 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:37.086029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:37.086029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:37.101545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:37.398714 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:37.407975 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:37.409536 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:37.410655 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1ca98bf7-4a4c-487c-bc29-0df4a6e4709d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1408 microversion: 2.20 time: 0.338452 Jul 12 07:17:37.411585 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 287/569] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:37 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:38.434340 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:38.435508 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:38.444252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:38.444692 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:38.445487 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:38.445919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:38.589836 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:38.598567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:38.600055 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:38.601182 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3d836d08-df47-403f-8edf-ad7b6889330e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1408 microversion: 2.20 time: 0.174349 Jul 12 07:17:38.601754 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 283/570] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:38 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:39.624642 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:39.625509 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:39.636061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:39.636816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:39.638421 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:39.639179 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:39.776383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:39.784813 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:39.786713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:39.787807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-718b29da-ad3c-47fc-a2d1-3b028cec0d95 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1408 microversion: 2.20 time: 0.170142 Jul 12 07:17:39.788359 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 288/571] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:39 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:40.806364 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:40.806965 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:40.813949 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:40.814404 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:40.815168 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:40.815611 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:40.949836 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:40.961866 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:40.964134 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:40.965834 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b12acbf5-5043-41c0-8405-09f00ded0f21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1408 microversion: 2.20 time: 0.163198 Jul 12 07:17:40.966651 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 284/572] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:40 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:41.809282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dc06f924-ae63-4356-8bf7-6f953dc46eb4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:41.810203 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dc06f924-ae63-4356-8bf7-6f953dc46eb4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:41.812113 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=4 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:41.817723 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc06f924-ae63-4356-8bf7-6f953dc46eb4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:41.818161 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc06f924-ae63-4356-8bf7-6f953dc46eb4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:41.818909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc06f924-ae63-4356-8bf7-6f953dc46eb4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:41.819342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc06f924-ae63-4356-8bf7-6f953dc46eb4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:41.848957 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dc06f924-ae63-4356-8bf7-6f953dc46eb4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043705 Jul 12 07:17:41.849547 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 289/573] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:17:41 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:17:41.910917 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cc39b888-c8d3-4b40-ad2a-57793ad3a231 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:41.911463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cc39b888-c8d3-4b40-ad2a-57793ad3a231 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:41.920952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc39b888-c8d3-4b40-ad2a-57793ad3a231 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:41.921535 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc39b888-c8d3-4b40-ad2a-57793ad3a231 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:41.922601 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc39b888-c8d3-4b40-ad2a-57793ad3a231 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:41.923105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cc39b888-c8d3-4b40-ad2a-57793ad3a231 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:41.948288 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cc39b888-c8d3-4b40-ad2a-57793ad3a231 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:17:41.985362 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:41.986211 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:41.992457 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:41.993362 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:41.993679 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:41.994104 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:42.029630 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cc39b888-c8d3-4b40-ad2a-57793ad3a231 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 204 len: 0 microversion: 2.1 time: 0.123653 Jul 12 07:17:42.030207 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 285/574] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:17:41 2022] DELETE /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 07:17:42.039143 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-be69b365-adbc-4aba-844a-909a90d5db2a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:42.039817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-be69b365-adbc-4aba-844a-909a90d5db2a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:42.045914 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be69b365-adbc-4aba-844a-909a90d5db2a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:42.046354 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be69b365-adbc-4aba-844a-909a90d5db2a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:42.047122 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be69b365-adbc-4aba-844a-909a90d5db2a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:42.047967 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-be69b365-adbc-4aba-844a-909a90d5db2a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:42.182425 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:42.190814 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:42.192281 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:42.193819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2eca77cf-5d73-4337-9d29-b091c657a6eb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1408 microversion: 2.20 time: 0.212653 Jul 12 07:17:42.194617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 290/575] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:41 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:17:42.212188 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-be69b365-adbc-4aba-844a-909a90d5db2a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:42.219986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-be69b365-adbc-4aba-844a-909a90d5db2a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1675 microversion: 2.1 time: 0.185090 Jul 12 07:17:42.220844 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 286/576] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:42 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:42.316676 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-11c76f65-453c-4f5d-9c3e-32571c0a159c req-16a3f2eb-650a-4648-8c28-7129fa87c5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8a7f04-501d-4547-b7ca-9e19f7d59c32", "name": "network-vif-plugged", "status": "completed", "tag": "3564b5da-8b1e-491d-b0b1-502090eeb718"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:42.325556 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-11c76f65-453c-4f5d-9c3e-32571c0a159c req-16a3f2eb-650a-4648-8c28-7129fa87c5e3 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:42.326091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-11c76f65-453c-4f5d-9c3e-32571c0a159c req-16a3f2eb-650a-4648-8c28-7129fa87c5e3 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:42.338283 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-11c76f65-453c-4f5d-9c3e-32571c0a159c req-16a3f2eb-650a-4648-8c28-7129fa87c5e3 service nova] Creating event network-vif-plugged:3564b5da-8b1e-491d-b0b1-502090eeb718 for instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 on hv-cinder-82549 Jul 12 07:17:42.343344 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-11c76f65-453c-4f5d-9c3e-32571c0a159c req-16a3f2eb-650a-4648-8c28-7129fa87c5e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031103 Jul 12 07:17:42.344137 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 291/577] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:43.216018 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:43.216948 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:43.220429 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:43.226247 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:43.226686 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:43.227439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:43.227857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:43.238061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-23b808c6-ece7-4481-8e2c-9b8389078a97 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:43.238740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-23b808c6-ece7-4481-8e2c-9b8389078a97 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:43.245182 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23b808c6-ece7-4481-8e2c-9b8389078a97 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:43.245637 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23b808c6-ece7-4481-8e2c-9b8389078a97 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:43.246389 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23b808c6-ece7-4481-8e2c-9b8389078a97 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:43.246819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23b808c6-ece7-4481-8e2c-9b8389078a97 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:43.347373 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=8 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:43.426454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:43.430787 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-23b808c6-ece7-4481-8e2c-9b8389078a97 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:43.435284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:43.437005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:43.438240 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-24053123-7f71-4be7-a3b9-72ba8779dfd1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1408 microversion: 2.20 time: 0.228864 Jul 12 07:17:43.438827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 287/578] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:43 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:43.439051 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-23b808c6-ece7-4481-8e2c-9b8389078a97 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1675 microversion: 2.1 time: 0.205191 Jul 12 07:17:43.439810 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 292/579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:43 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:44.456400 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-423b7e4b-2d1a-47dd-8244-e668761529ff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:44.457024 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:44.457417 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-423b7e4b-2d1a-47dd-8244-e668761529ff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:44.457513 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:44.464003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-423b7e4b-2d1a-47dd-8244-e668761529ff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:44.464331 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:44.464482 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-423b7e4b-2d1a-47dd-8244-e668761529ff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:44.465014 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:44.467688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-423b7e4b-2d1a-47dd-8244-e668761529ff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:44.467688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-423b7e4b-2d1a-47dd-8244-e668761529ff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:44.467874 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:44.467874 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:44.788594 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:44.793092 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-423b7e4b-2d1a-47dd-8244-e668761529ff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:44.800912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:44.802463 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:44.802872 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-423b7e4b-2d1a-47dd-8244-e668761529ff tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1675 microversion: 2.1 time: 0.350459 Jul 12 07:17:44.803547 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1a3f40d1-c2ac-4009-8e4a-0047d9322e6d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1408 microversion: 2.20 time: 0.351099 Jul 12 07:17:44.803701 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 288/580] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:44 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1675 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:44.804392 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 293/581] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:44 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1408 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:45.352103 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-6242a418-4ba6-45ce-a539-0cafb4a377a3 req-dbac39f2-373c-463e-875a-4b5e64f2267e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7", "name": "network-vif-deleted", "tag": "eab59db7-2167-4352-a4bb-fb23a341c8a3"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:45.361245 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-6242a418-4ba6-45ce-a539-0cafb4a377a3 req-dbac39f2-373c-463e-875a-4b5e64f2267e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:45.361792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-6242a418-4ba6-45ce-a539-0cafb4a377a3 req-dbac39f2-373c-463e-875a-4b5e64f2267e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:45.373275 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-6242a418-4ba6-45ce-a539-0cafb4a377a3 req-dbac39f2-373c-463e-875a-4b5e64f2267e service nova] Creating event network-vif-deleted:eab59db7-2167-4352-a4bb-fb23a341c8a3 for instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 on hv-cinder-82549 Jul 12 07:17:45.379421 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-6242a418-4ba6-45ce-a539-0cafb4a377a3 req-dbac39f2-373c-463e-875a-4b5e64f2267e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030977 Jul 12 07:17:45.380135 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 289/582] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:45.834043 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:45.834640 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:45.840007 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:45.840676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:45.847106 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:45.847810 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:45.848576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:45.848851 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:45.848984 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:45.849625 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:45.850393 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:45.850822 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:45.880993 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:45.881457 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:45.881901 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lazy-loading 'fault' on Instance uuid aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:17:45.937486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:45.945769 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0d6b8d59-6968-434f-b19a-cd738d76e6f4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 200 len: 1328 microversion: 2.1 time: 0.119996 Jul 12 07:17:45.946575 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 294/583] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:45 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:46.015183 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:46.023639 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:46.025132 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:46.026270 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c3ef767e-a1b3-48a0-baa8-95bf31e238e7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1601 microversion: 2.20 time: 0.196695 Jul 12 07:17:46.026823 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 290/584] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:17:45 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1601 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:17:46.044264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a60300a-caa3-4d0c-ab3c-7a48dcdf5f06 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:46.044826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a60300a-caa3-4d0c-ab3c-7a48dcdf5f06 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:46.051504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a60300a-caa3-4d0c-ab3c-7a48dcdf5f06 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:46.051949 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a60300a-caa3-4d0c-ab3c-7a48dcdf5f06 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:46.052712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a60300a-caa3-4d0c-ab3c-7a48dcdf5f06 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:46.053166 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a60300a-caa3-4d0c-ab3c-7a48dcdf5f06 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:46.131772 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a60300a-caa3-4d0c-ab3c-7a48dcdf5f06 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091361 Jul 12 07:17:46.132504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 295/585] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 12 07:17:46 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:17:46.963547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:46.964145 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:46.970712 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:46.971200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:46.971952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:46.972408 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:46.985919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] HTTP exception thrown: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Request method failure captured: Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 HTTP/1.1 Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8KYjPkdJ43t88kh-kC7MeiVe2L7S7xD28zModJqTETNXQzVeciG8G6d95pLBwCJG2EpfLLrqW0rBC9Q0_NfWZB_v4CmQq0vVZRlmEq3l75cmkr0jM8dcdbf4e_QJQ0AmxJf2DTY561h75jhdbu9UtbGrBKxvSbTRYJ-1ET2tGTQ3Y Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:17:46.987703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6be635735d174893be20f99110cacbfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6be635735d174893be20f99110cacbfa"}]}] Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 583143af14a645238262214515ee148f Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:17:46.989005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7'} Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:17:46.990106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:17:46.991316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:17:46.992381 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Returning 404 to user: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:17:46.992381 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6a9e5577-c636-4f20-bac4-bdea4f5ae388 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 404 len: 111 microversion: 2.1 time: 0.029722 Jul 12 07:17:46.992381 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 291/586] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:46 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:17:46.999336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c318c79-1bd9-4fb4-93a9-f6cb6d8dae20 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '.version_select at 0x7f70117b63a0>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:47.020811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c318c79-1bd9-4fb4-93a9-f6cb6d8dae20 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909216290" status: 202 len: 0 microversion: 2.1 time: 0.026267 Jul 12 07:17:47.021771 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 296/587] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 12 07:17:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909216290 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:17:47.102089 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-66da6f05-6bd5-47ea-9d03-ddbe12cba7c6 req-683033a5-1e12-439b-a476-2b4a4a5ed24c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db8a7f04-501d-4547-b7ca-9e19f7d59c32", "tag": "3564b5da-8b1e-491d-b0b1-502090eeb718"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:47.110557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-66da6f05-6bd5-47ea-9d03-ddbe12cba7c6 req-683033a5-1e12-439b-a476-2b4a4a5ed24c service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:47.111294 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-66da6f05-6bd5-47ea-9d03-ddbe12cba7c6 req-683033a5-1e12-439b-a476-2b4a4a5ed24c service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:47.125108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-66da6f05-6bd5-47ea-9d03-ddbe12cba7c6 req-683033a5-1e12-439b-a476-2b4a4a5ed24c service nova] Creating event network-changed:3564b5da-8b1e-491d-b0b1-502090eeb718 for instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 on hv-cinder-82549 Jul 12 07:17:47.130992 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-66da6f05-6bd5-47ea-9d03-ddbe12cba7c6 req-683033a5-1e12-439b-a476-2b4a4a5ed24c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032674 Jul 12 07:17:47.131603 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 292/588] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:48.242371 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dab7a000-02f9-4aa6-ac41-e0ced3c5236c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'create', calling method: .version_select at 0x7f70117485e0>, body: {"keypair": {"name": "tempest-keypair-1285700976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhbY1t4DtRyhZKg6xamuq36bU3k9kBOMI2T6i0j6DUZrcOPFA177jxTLQNA8O9palZ8nZFdsOCIe870I4YU0NcO9npwIURf5M7vF4ECkssCo41YPuOMxuAiJqg37Z8hOA=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:48.261726 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-dab7a000-02f9-4aa6-ac41-e0ced3c5236c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Getting quotas for project 6be635735d174893be20f99110cacbfa. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:17:48.267504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-dab7a000-02f9-4aa6-ac41-e0ced3c5236c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Getting quotas for user 583143af14a645238262214515ee148f and project 6be635735d174893be20f99110cacbfa. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:17:48.286262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:48.295141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dab7a000-02f9-4aa6-ac41-e0ced3c5236c tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056658 Jul 12 07:17:48.295909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 297/589] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:17:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:49.619698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2063963198", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2bae3d57-a0aa-4a3b-ba1d-f05c52c7ab17"}], "security_groups": [{"name": "tempest-securitygroup--892324084"}], "key_name": "tempest-keypair-1285700976", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:49.730879 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] validate_networks() for [('2bae3d57-a0aa-4a3b-ba1d-f05c52c7ab17', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:17:50.115015 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:17:50.115546 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:17:50.115991 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:17:50.116387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:17:50.116807 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:17:50.125819 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:50.126256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:50.127035 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:50.127680 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:50.144296 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Getting quotas for project 6be635735d174893be20f99110cacbfa. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:17:50.148307 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Getting quotas for user 583143af14a645238262214515ee148f and project 6be635735d174893be20f99110cacbfa. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:17:50.159577 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:17:50.162328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:17:50.210054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5fbb2a50-c1af-4839-8d0b-fd739a345e13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.598826 Jul 12 07:17:50.210666 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 293/590] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:17:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:17:50.221841 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-345f1f8c-4412-44ce-96c2-1c992cece03b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:50.222422 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-345f1f8c-4412-44ce-96c2-1c992cece03b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:50.285763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-345f1f8c-4412-44ce-96c2-1c992cece03b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:50.294596 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-345f1f8c-4412-44ce-96c2-1c992cece03b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1238 microversion: 2.1 time: 0.077605 Jul 12 07:17:50.295511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 298/591] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:50 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:51.314375 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-71282c46-3ff5-475c-9576-d8e3d4c4b322 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:51.315110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-71282c46-3ff5-475c-9576-d8e3d4c4b322 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:51.322813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71282c46-3ff5-475c-9576-d8e3d4c4b322 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:51.323263 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71282c46-3ff5-475c-9576-d8e3d4c4b322 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:51.324091 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71282c46-3ff5-475c-9576-d8e3d4c4b322 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:51.324529 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71282c46-3ff5-475c-9576-d8e3d4c4b322 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:51.397622 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-71282c46-3ff5-475c-9576-d8e3d4c4b322 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:51.405457 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-71282c46-3ff5-475c-9576-d8e3d4c4b322 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1298 microversion: 2.1 time: 0.095928 Jul 12 07:17:51.406021 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 294/592] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:51 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:52.424772 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0467a799-4bfd-442d-86d5-7392d738c1c4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:52.425393 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0467a799-4bfd-442d-86d5-7392d738c1c4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:52.432692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0467a799-4bfd-442d-86d5-7392d738c1c4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:52.433296 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0467a799-4bfd-442d-86d5-7392d738c1c4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:52.434216 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0467a799-4bfd-442d-86d5-7392d738c1c4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:52.434721 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0467a799-4bfd-442d-86d5-7392d738c1c4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:52.642364 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0467a799-4bfd-442d-86d5-7392d738c1c4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:52.650151 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0467a799-4bfd-442d-86d5-7392d738c1c4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1363 microversion: 2.1 time: 0.230079 Jul 12 07:17:52.650726 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 299/593] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:52 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:53.015496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-751917a2-6ad9-4ce5-b7bb-477bfd3bbbb2 req-9b99d88d-549c-4cca-91e9-5004f5463d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe4fd46-2e3e-473e-952d-7bae1741f74b", "tag": "aa44cae3-47b4-4937-8462-55d04fdc53d0"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:53.034321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-751917a2-6ad9-4ce5-b7bb-477bfd3bbbb2 req-9b99d88d-549c-4cca-91e9-5004f5463d55 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:53.035653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-751917a2-6ad9-4ce5-b7bb-477bfd3bbbb2 req-9b99d88d-549c-4cca-91e9-5004f5463d55 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:53.049704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-751917a2-6ad9-4ce5-b7bb-477bfd3bbbb2 req-9b99d88d-549c-4cca-91e9-5004f5463d55 service nova] Creating event network-changed:aa44cae3-47b4-4937-8462-55d04fdc53d0 for instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b on hv-cinder-82549 Jul 12 07:17:53.055195 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-751917a2-6ad9-4ce5-b7bb-477bfd3bbbb2 req-9b99d88d-549c-4cca-91e9-5004f5463d55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043541 Jul 12 07:17:53.056010 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 295/594] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:53.667851 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eae306f3-ae98-4571-b41b-025a15ef10f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:53.668522 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eae306f3-ae98-4571-b41b-025a15ef10f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:53.675019 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eae306f3-ae98-4571-b41b-025a15ef10f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:53.675452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eae306f3-ae98-4571-b41b-025a15ef10f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:53.676223 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eae306f3-ae98-4571-b41b-025a15ef10f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:53.676650 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eae306f3-ae98-4571-b41b-025a15ef10f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:53.826695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eae306f3-ae98-4571-b41b-025a15ef10f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:53.835044 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eae306f3-ae98-4571-b41b-025a15ef10f0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1363 microversion: 2.1 time: 0.171123 Jul 12 07:17:53.835636 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 300/595] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:53 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:54.852908 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-96ef1361-1bc8-4aab-bb4f-3478e2a24ad3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:54.853674 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-96ef1361-1bc8-4aab-bb4f-3478e2a24ad3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:54.861493 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96ef1361-1bc8-4aab-bb4f-3478e2a24ad3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:54.861923 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96ef1361-1bc8-4aab-bb4f-3478e2a24ad3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:54.862723 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96ef1361-1bc8-4aab-bb4f-3478e2a24ad3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:54.863317 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-96ef1361-1bc8-4aab-bb4f-3478e2a24ad3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:55.320292 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-96ef1361-1bc8-4aab-bb4f-3478e2a24ad3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:55.327940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-96ef1361-1bc8-4aab-bb4f-3478e2a24ad3 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1363 microversion: 2.1 time: 0.479594 Jul 12 07:17:55.328482 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 296/596] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:54 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1363 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:17:56.345768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-92eb6436-f8ca-4999-b96a-f8ed53ac5479 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:56.346359 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-92eb6436-f8ca-4999-b96a-f8ed53ac5479 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:56.353498 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92eb6436-f8ca-4999-b96a-f8ed53ac5479 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:56.353932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92eb6436-f8ca-4999-b96a-f8ed53ac5479 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:56.354699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92eb6436-f8ca-4999-b96a-f8ed53ac5479 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:56.355119 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92eb6436-f8ca-4999-b96a-f8ed53ac5479 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:56.495100 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-92eb6436-f8ca-4999-b96a-f8ed53ac5479 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:56.502690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-92eb6436-f8ca-4999-b96a-f8ed53ac5479 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1363 microversion: 2.1 time: 0.160949 Jul 12 07:17:56.503241 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 301/597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:56 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:57.519674 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ab0b3767-d55f-4c7f-a41c-0f70409f0e53 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:57.520271 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ab0b3767-d55f-4c7f-a41c-0f70409f0e53 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:57.527423 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ab0b3767-d55f-4c7f-a41c-0f70409f0e53 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:57.527868 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ab0b3767-d55f-4c7f-a41c-0f70409f0e53 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:57.528623 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ab0b3767-d55f-4c7f-a41c-0f70409f0e53 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:57.529074 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ab0b3767-d55f-4c7f-a41c-0f70409f0e53 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:57.544797 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:57.665722 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ab0b3767-d55f-4c7f-a41c-0f70409f0e53 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:57.673242 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ab0b3767-d55f-4c7f-a41c-0f70409f0e53 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1363 microversion: 2.1 time: 0.157633 Jul 12 07:17:57.673837 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 297/598] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:57 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:58.415268 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-acbb9c0d-a80c-4c89-906c-6e5e870ab0bd req-dcffc88d-3ce2-40e6-8cee-e2489d8bfcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe4fd46-2e3e-473e-952d-7bae1741f74b", "name": "network-vif-plugged", "status": "completed", "tag": "aa44cae3-47b4-4937-8462-55d04fdc53d0"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:17:58.423443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-acbb9c0d-a80c-4c89-906c-6e5e870ab0bd req-dcffc88d-3ce2-40e6-8cee-e2489d8bfcac service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:58.423934 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-acbb9c0d-a80c-4c89-906c-6e5e870ab0bd req-dcffc88d-3ce2-40e6-8cee-e2489d8bfcac service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:58.436012 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-acbb9c0d-a80c-4c89-906c-6e5e870ab0bd req-dcffc88d-3ce2-40e6-8cee-e2489d8bfcac service nova] Creating event network-vif-plugged:aa44cae3-47b4-4937-8462-55d04fdc53d0 for instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b on hv-cinder-82549 Jul 12 07:17:58.440920 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-acbb9c0d-a80c-4c89-906c-6e5e870ab0bd req-dcffc88d-3ce2-40e6-8cee-e2489d8bfcac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029448 Jul 12 07:17:58.441544 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 302/599] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:17:58.691734 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-aefbf026-8998-4539-8c0f-a02f939ab62a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:58.692608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-aefbf026-8998-4539-8c0f-a02f939ab62a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:58.699328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aefbf026-8998-4539-8c0f-a02f939ab62a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:58.699827 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aefbf026-8998-4539-8c0f-a02f939ab62a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:58.700666 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aefbf026-8998-4539-8c0f-a02f939ab62a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:58.701122 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-aefbf026-8998-4539-8c0f-a02f939ab62a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:58.847496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-aefbf026-8998-4539-8c0f-a02f939ab62a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:17:58.855083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-aefbf026-8998-4539-8c0f-a02f939ab62a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1363 microversion: 2.1 time: 0.168466 Jul 12 07:17:58.855656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 298/600] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:58 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:17:59.876992 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4a3fc04d-1f94-433c-b769-e2e1190d9f3e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:17:59.878155 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4a3fc04d-1f94-433c-b769-e2e1190d9f3e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:17:59.888903 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a3fc04d-1f94-433c-b769-e2e1190d9f3e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:59.889675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a3fc04d-1f94-433c-b769-e2e1190d9f3e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:17:59.890937 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a3fc04d-1f94-433c-b769-e2e1190d9f3e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:17:59.891616 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a3fc04d-1f94-433c-b769-e2e1190d9f3e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:00.195858 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4a3fc04d-1f94-433c-b769-e2e1190d9f3e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:00.207085 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4a3fc04d-1f94-433c-b769-e2e1190d9f3e tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1363 microversion: 2.1 time: 0.336916 Jul 12 07:18:00.208059 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 303/601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:17:59 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:01.232842 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-669dcf12-e14d-475c-b812-2d86707f1a13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:01.233795 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-669dcf12-e14d-475c-b812-2d86707f1a13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:01.237522 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:01.238850 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:01.245511 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-669dcf12-e14d-475c-b812-2d86707f1a13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:01.245950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-669dcf12-e14d-475c-b812-2d86707f1a13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:01.246699 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-669dcf12-e14d-475c-b812-2d86707f1a13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:01.247122 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-669dcf12-e14d-475c-b812-2d86707f1a13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:01.443100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-669dcf12-e14d-475c-b812-2d86707f1a13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:01.451271 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-669dcf12-e14d-475c-b812-2d86707f1a13 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1550 microversion: 2.1 time: 0.224962 Jul 12 07:18:01.451814 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 299/602] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:01 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1550 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:01.468022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6be64bac-2ca7-432d-b04f-4fc645287799 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:01.468583 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6be64bac-2ca7-432d-b04f-4fc645287799 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:01.470560 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=6 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:01.476548 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6be64bac-2ca7-432d-b04f-4fc645287799 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:01.476988 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6be64bac-2ca7-432d-b04f-4fc645287799 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:01.477781 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6be64bac-2ca7-432d-b04f-4fc645287799 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:01.478209 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6be64bac-2ca7-432d-b04f-4fc645287799 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:01.559273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6be64bac-2ca7-432d-b04f-4fc645287799 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094750 Jul 12 07:18:01.560300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 304/603] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 07:18:01 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:02.545483 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-a437b8da-2457-40a8-baa4-d6b91529cd2e req-709e3323-3076-4ae0-a4f7-33ee7164d426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe4fd46-2e3e-473e-952d-7bae1741f74b", "tag": "aa44cae3-47b4-4937-8462-55d04fdc53d0"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:02.554662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-a437b8da-2457-40a8-baa4-d6b91529cd2e req-709e3323-3076-4ae0-a4f7-33ee7164d426 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:02.555111 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-a437b8da-2457-40a8-baa4-d6b91529cd2e req-709e3323-3076-4ae0-a4f7-33ee7164d426 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:02.566397 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-a437b8da-2457-40a8-baa4-d6b91529cd2e req-709e3323-3076-4ae0-a4f7-33ee7164d426 service nova] Creating event network-changed:aa44cae3-47b4-4937-8462-55d04fdc53d0 for instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b on hv-cinder-82549 Jul 12 07:18:02.571998 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-a437b8da-2457-40a8-baa4-d6b91529cd2e req-709e3323-3076-4ae0-a4f7-33ee7164d426 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030333 Jul 12 07:18:02.572815 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 300/604] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:04.870536 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b9046b21-7d8e-4d48-8e79-51d3514ba05d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:04.871160 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b9046b21-7d8e-4d48-8e79-51d3514ba05d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:04.878097 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9046b21-7d8e-4d48-8e79-51d3514ba05d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:04.878509 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9046b21-7d8e-4d48-8e79-51d3514ba05d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:04.879353 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9046b21-7d8e-4d48-8e79-51d3514ba05d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:04.879788 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9046b21-7d8e-4d48-8e79-51d3514ba05d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:04.902537 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-b9046b21-7d8e-4d48-8e79-51d3514ba05d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lazy-loading 'flavor' on Instance uuid cf7ccb04-eb99-4561-9c24-4480c4e0422e {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:18:04.979192 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b9046b21-7d8e-4d48-8e79-51d3514ba05d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "POST /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e/action" status: 202 len: 0 microversion: 2.1 time: 0.112428 Jul 12 07:18:04.979890 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 305/605] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:18:04 2022] POST /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:18:04.989830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a6d7ad10-7c06-4294-854f-b8f31e321ba3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:04.990546 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a6d7ad10-7c06-4294-854f-b8f31e321ba3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:04.993662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:04.997917 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a6d7ad10-7c06-4294-854f-b8f31e321ba3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:04.998370 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a6d7ad10-7c06-4294-854f-b8f31e321ba3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:04.999170 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a6d7ad10-7c06-4294-854f-b8f31e321ba3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:04.999570 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a6d7ad10-7c06-4294-854f-b8f31e321ba3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:05.135025 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a6d7ad10-7c06-4294-854f-b8f31e321ba3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:05.146167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a6d7ad10-7c06-4294-854f-b8f31e321ba3 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.161240 Jul 12 07:18:05.146724 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 301/606] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:04 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:06.165927 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08d3518b-614c-4d28-9c54-ab8d2adc0703 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:06.166607 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08d3518b-614c-4d28-9c54-ab8d2adc0703 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:06.173386 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08d3518b-614c-4d28-9c54-ab8d2adc0703 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:06.173825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08d3518b-614c-4d28-9c54-ab8d2adc0703 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:06.174566 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08d3518b-614c-4d28-9c54-ab8d2adc0703 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:06.174991 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08d3518b-614c-4d28-9c54-ab8d2adc0703 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:06.325704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08d3518b-614c-4d28-9c54-ab8d2adc0703 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:06.328041 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:06.334859 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08d3518b-614c-4d28-9c54-ab8d2adc0703 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.173203 Jul 12 07:18:06.335423 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 306/607] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:06 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:07.356670 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-71cd8e7b-29b2-41d4-b0dd-34c8c18c2669 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:07.357489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-71cd8e7b-29b2-41d4-b0dd-34c8c18c2669 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:07.367372 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71cd8e7b-29b2-41d4-b0dd-34c8c18c2669 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:07.367866 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71cd8e7b-29b2-41d4-b0dd-34c8c18c2669 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:07.368604 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71cd8e7b-29b2-41d4-b0dd-34c8c18c2669 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:07.369034 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-71cd8e7b-29b2-41d4-b0dd-34c8c18c2669 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:07.515401 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-71cd8e7b-29b2-41d4-b0dd-34c8c18c2669 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:07.523711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-71cd8e7b-29b2-41d4-b0dd-34c8c18c2669 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.173496 Jul 12 07:18:07.524291 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 302/608] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:07 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:08.542916 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9f9fdfd1-aaef-431d-8493-c16a9e5aec3b tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:08.543628 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9f9fdfd1-aaef-431d-8493-c16a9e5aec3b tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:08.551160 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f9fdfd1-aaef-431d-8493-c16a9e5aec3b tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:08.551599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f9fdfd1-aaef-431d-8493-c16a9e5aec3b tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:08.552353 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f9fdfd1-aaef-431d-8493-c16a9e5aec3b tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:08.552783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f9fdfd1-aaef-431d-8493-c16a9e5aec3b tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:08.688993 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9f9fdfd1-aaef-431d-8493-c16a9e5aec3b tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:08.696739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9f9fdfd1-aaef-431d-8493-c16a9e5aec3b tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.158642 Jul 12 07:18:08.697368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 307/609] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:08 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:09.718223 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7d10445e-077a-4e19-b83c-ae61c00763c7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:09.719204 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7d10445e-077a-4e19-b83c-ae61c00763c7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:09.729246 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d10445e-077a-4e19-b83c-ae61c00763c7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:09.729690 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d10445e-077a-4e19-b83c-ae61c00763c7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:09.730455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d10445e-077a-4e19-b83c-ae61c00763c7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:09.730884 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7d10445e-077a-4e19-b83c-ae61c00763c7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:09.881275 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7d10445e-077a-4e19-b83c-ae61c00763c7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:09.889084 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7d10445e-077a-4e19-b83c-ae61c00763c7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.177725 Jul 12 07:18:09.889694 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 303/610] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:09 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:10.911209 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dcf3812f-1b24-4020-a051-7bfacba9ea04 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:10.912134 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dcf3812f-1b24-4020-a051-7bfacba9ea04 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:10.923193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf3812f-1b24-4020-a051-7bfacba9ea04 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:10.923932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf3812f-1b24-4020-a051-7bfacba9ea04 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:10.925225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf3812f-1b24-4020-a051-7bfacba9ea04 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:10.925956 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf3812f-1b24-4020-a051-7bfacba9ea04 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:11.066151 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dcf3812f-1b24-4020-a051-7bfacba9ea04 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:11.073910 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dcf3812f-1b24-4020-a051-7bfacba9ea04 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.169767 Jul 12 07:18:11.074448 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 308/611] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:10 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:12.099532 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-48299421-6686-4891-9671-d7e1b6c1f5a5 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:12.100167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-48299421-6686-4891-9671-d7e1b6c1f5a5 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:12.107527 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48299421-6686-4891-9671-d7e1b6c1f5a5 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:12.107969 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48299421-6686-4891-9671-d7e1b6c1f5a5 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:12.108727 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48299421-6686-4891-9671-d7e1b6c1f5a5 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:12.109206 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-48299421-6686-4891-9671-d7e1b6c1f5a5 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:12.257286 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-48299421-6686-4891-9671-d7e1b6c1f5a5 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:12.265440 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-48299421-6686-4891-9671-d7e1b6c1f5a5 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.171487 Jul 12 07:18:12.266014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 304/612] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:12 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:13.287814 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6d1b1d24-4dbf-489a-954b-8489848a5ecd tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:13.288709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6d1b1d24-4dbf-489a-954b-8489848a5ecd tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:13.299296 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d1b1d24-4dbf-489a-954b-8489848a5ecd tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:13.300034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d1b1d24-4dbf-489a-954b-8489848a5ecd tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:13.301320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d1b1d24-4dbf-489a-954b-8489848a5ecd tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:13.302037 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d1b1d24-4dbf-489a-954b-8489848a5ecd tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:13.435349 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6d1b1d24-4dbf-489a-954b-8489848a5ecd tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:13.442945 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6d1b1d24-4dbf-489a-954b-8489848a5ecd tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.162196 Jul 12 07:18:13.443511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 309/613] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:13 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:13.464150 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5f7291fb-2494-4551-9cb0-0e806e0bf1af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:13.464664 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5f7291fb-2494-4551-9cb0-0e806e0bf1af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:13.471862 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f7291fb-2494-4551-9cb0-0e806e0bf1af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:13.472281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f7291fb-2494-4551-9cb0-0e806e0bf1af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:13.473044 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f7291fb-2494-4551-9cb0-0e806e0bf1af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:13.473533 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5f7291fb-2494-4551-9cb0-0e806e0bf1af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:13.558466 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-5f7291fb-2494-4551-9cb0-0e806e0bf1af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lazy-loading 'services' on Instance uuid 59be899b-3595-4b0a-9e4c-969db0bb9c77 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:18:13.636219 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5f7291fb-2494-4551-9cb0-0e806e0bf1af tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments/fbc8b6ba-e0b9-445a-8f72-f3c48ef88029" status: 202 len: 0 microversion: 2.1 time: 0.175937 Jul 12 07:18:13.636816 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 305/614] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:18:13 2022] DELETE /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments/fbc8b6ba-e0b9-445a-8f72-f3c48ef88029 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:18:13.645296 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-71851d68-4585-4cf7-a67d-7cf8b9eaa8e6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:13.646223 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-71851d68-4585-4cf7-a67d-7cf8b9eaa8e6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:13.652474 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-71851d68-4585-4cf7-a67d-7cf8b9eaa8e6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:13.653030 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-71851d68-4585-4cf7-a67d-7cf8b9eaa8e6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:13.653720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-71851d68-4585-4cf7-a67d-7cf8b9eaa8e6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:13.654180 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-71851d68-4585-4cf7-a67d-7cf8b9eaa8e6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:13.685190 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-71851d68-4585-4cf7-a67d-7cf8b9eaa8e6 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043840 Jul 12 07:18:13.685747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 310/615] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:18:13 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:14.460516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b5cf4e52-ab4d-4ec6-8225-6314996769da tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:14.461224 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b5cf4e52-ab4d-4ec6-8225-6314996769da tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:14.467612 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5cf4e52-ab4d-4ec6-8225-6314996769da tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:14.468266 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5cf4e52-ab4d-4ec6-8225-6314996769da tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:14.468844 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5cf4e52-ab4d-4ec6-8225-6314996769da tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:14.469295 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b5cf4e52-ab4d-4ec6-8225-6314996769da tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:14.608667 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b5cf4e52-ab4d-4ec6-8225-6314996769da tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:14.616860 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b5cf4e52-ab4d-4ec6-8225-6314996769da tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.160778 Jul 12 07:18:14.617467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 306/616] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:14 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:14.700379 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5c9b1b1a-e6f8-4ed1-8e5b-2c4fc285bbde tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:14.702279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5c9b1b1a-e6f8-4ed1-8e5b-2c4fc285bbde tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:14.714044 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c9b1b1a-e6f8-4ed1-8e5b-2c4fc285bbde tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:14.714492 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c9b1b1a-e6f8-4ed1-8e5b-2c4fc285bbde tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:14.715261 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c9b1b1a-e6f8-4ed1-8e5b-2c4fc285bbde tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:14.715695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c9b1b1a-e6f8-4ed1-8e5b-2c4fc285bbde tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:14.745649 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5c9b1b1a-e6f8-4ed1-8e5b-2c4fc285bbde tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051424 Jul 12 07:18:14.746218 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 311/617] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:18:14 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:15.197631 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-729bb60c-ac14-4f2c-88a7-1ef961556dd5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:15.198135 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-729bb60c-ac14-4f2c-88a7-1ef961556dd5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:15.204643 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-729bb60c-ac14-4f2c-88a7-1ef961556dd5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:15.205078 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-729bb60c-ac14-4f2c-88a7-1ef961556dd5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:15.205867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-729bb60c-ac14-4f2c-88a7-1ef961556dd5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:15.206285 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-729bb60c-ac14-4f2c-88a7-1ef961556dd5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:15.229598 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-729bb60c-ac14-4f2c-88a7-1ef961556dd5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/ips" status: 200 len: 149 microversion: 2.1 time: 0.038538 Jul 12 07:18:15.230158 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 307/618] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:18:15 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:15.634152 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9177415-c8d8-4d65-8c26-3406fce36e15 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:15.634977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d9177415-c8d8-4d65-8c26-3406fce36e15 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:15.642035 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9177415-c8d8-4d65-8c26-3406fce36e15 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:15.642559 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9177415-c8d8-4d65-8c26-3406fce36e15 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:15.643373 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9177415-c8d8-4d65-8c26-3406fce36e15 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:15.643861 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9177415-c8d8-4d65-8c26-3406fce36e15 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:15.757648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-927aebaf-78a6-48c1-8755-77d4ccca254f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:15.759416 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-927aebaf-78a6-48c1-8755-77d4ccca254f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:15.766900 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-927aebaf-78a6-48c1-8755-77d4ccca254f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:15.767346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-927aebaf-78a6-48c1-8755-77d4ccca254f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:15.768543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-927aebaf-78a6-48c1-8755-77d4ccca254f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:15.768975 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-927aebaf-78a6-48c1-8755-77d4ccca254f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:15.799391 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-927aebaf-78a6-48c1-8755-77d4ccca254f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045628 Jul 12 07:18:15.800167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 308/619] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:18:15 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:18:15.862266 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d9177415-c8d8-4d65-8c26-3406fce36e15 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:15.871530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d9177415-c8d8-4d65-8c26-3406fce36e15 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.241341 Jul 12 07:18:15.872561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 312/620] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:15 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:15.877550 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-74f9c6c2-4c33-4023-80dd-b17b46c14bc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:15.878033 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-74f9c6c2-4c33-4023-80dd-b17b46c14bc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:15.884412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74f9c6c2-4c33-4023-80dd-b17b46c14bc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:15.884892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74f9c6c2-4c33-4023-80dd-b17b46c14bc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:15.885678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74f9c6c2-4c33-4023-80dd-b17b46c14bc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:15.886100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-74f9c6c2-4c33-4023-80dd-b17b46c14bc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:15.911547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-74f9c6c2-4c33-4023-80dd-b17b46c14bc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:18:15.996643 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-74f9c6c2-4c33-4023-80dd-b17b46c14bc1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 204 len: 0 microversion: 2.1 time: 0.122104 Jul 12 07:18:15.997971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 309/621] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:18:15 2022] DELETE /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:18:16.009297 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-abebf31d-a5f6-4032-8624-ed30fe334360 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:16.010070 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-abebf31d-a5f6-4032-8624-ed30fe334360 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:16.016243 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abebf31d-a5f6-4032-8624-ed30fe334360 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:16.016647 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abebf31d-a5f6-4032-8624-ed30fe334360 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:16.017411 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abebf31d-a5f6-4032-8624-ed30fe334360 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:16.017832 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abebf31d-a5f6-4032-8624-ed30fe334360 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:16.148172 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-abebf31d-a5f6-4032-8624-ed30fe334360 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:16.156079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-abebf31d-a5f6-4032-8624-ed30fe334360 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1690 microversion: 2.1 time: 0.153143 Jul 12 07:18:16.156642 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 313/622] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:16 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:16.583018 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ee625ca0-5900-4adb-8978-f5bd0786f621 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbe5314f-a639-47e8-a121-2d9263201334"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:16.584170 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ee625ca0-5900-4adb-8978-f5bd0786f621 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:16.592192 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee625ca0-5900-4adb-8978-f5bd0786f621 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:16.592785 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee625ca0-5900-4adb-8978-f5bd0786f621 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:16.593925 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee625ca0-5900-4adb-8978-f5bd0786f621 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:16.594510 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ee625ca0-5900-4adb-8978-f5bd0786f621 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:16.893242 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ff2c9fa4-c40c-4d8c-b139-d0038799500e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:16.894122 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ff2c9fa4-c40c-4d8c-b139-d0038799500e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:16.903038 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff2c9fa4-c40c-4d8c-b139-d0038799500e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:16.903480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff2c9fa4-c40c-4d8c-b139-d0038799500e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:16.904232 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff2c9fa4-c40c-4d8c-b139-d0038799500e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:16.904660 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff2c9fa4-c40c-4d8c-b139-d0038799500e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:17.042646 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ff2c9fa4-c40c-4d8c-b139-d0038799500e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:17.050775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ff2c9fa4-c40c-4d8c-b139-d0038799500e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.164161 Jul 12 07:18:17.051345 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 314/623] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:16 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:17.182258 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-04af3996-32d6-474b-84b5-6f62389b4c47 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:17.183272 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-04af3996-32d6-474b-84b5-6f62389b4c47 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:17.193522 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04af3996-32d6-474b-84b5-6f62389b4c47 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:17.194254 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04af3996-32d6-474b-84b5-6f62389b4c47 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:17.195484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04af3996-32d6-474b-84b5-6f62389b4c47 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:17.196185 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04af3996-32d6-474b-84b5-6f62389b4c47 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:17.337638 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-04af3996-32d6-474b-84b5-6f62389b4c47 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:17.345318 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-04af3996-32d6-474b-84b5-6f62389b4c47 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1690 microversion: 2.1 time: 0.169883 Jul 12 07:18:17.345881 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 315/624] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:17 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:18.070476 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8950a7ae-f381-4518-a950-409549815084 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:18.071174 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8950a7ae-f381-4518-a950-409549815084 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:18.078050 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8950a7ae-f381-4518-a950-409549815084 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:18.078497 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8950a7ae-f381-4518-a950-409549815084 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:18.079254 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8950a7ae-f381-4518-a950-409549815084 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:18.079680 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8950a7ae-f381-4518-a950-409549815084 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:18.213370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8950a7ae-f381-4518-a950-409549815084 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:18.225127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8950a7ae-f381-4518-a950-409549815084 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.160369 Jul 12 07:18:18.225976 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 316/625] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:18 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:18.422364 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b3c57359-25e6-44d7-a1a6-ac9ba24c0163 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:18.423030 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b3c57359-25e6-44d7-a1a6-ac9ba24c0163 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:18.429253 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3c57359-25e6-44d7-a1a6-ac9ba24c0163 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:18.429685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3c57359-25e6-44d7-a1a6-ac9ba24c0163 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:18.430427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3c57359-25e6-44d7-a1a6-ac9ba24c0163 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:18.430848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3c57359-25e6-44d7-a1a6-ac9ba24c0163 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:18.564286 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b3c57359-25e6-44d7-a1a6-ac9ba24c0163 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:18.572458 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b3c57359-25e6-44d7-a1a6-ac9ba24c0163 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1690 microversion: 2.1 time: 0.213489 Jul 12 07:18:18.572991 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 317/626] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:18 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:19.247199 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e00e3215-f5fd-493c-ab80-7b3dc82b4a0c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:19.248277 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e00e3215-f5fd-493c-ab80-7b3dc82b4a0c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:19.258658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e00e3215-f5fd-493c-ab80-7b3dc82b4a0c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:19.259435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e00e3215-f5fd-493c-ab80-7b3dc82b4a0c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:19.260612 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e00e3215-f5fd-493c-ab80-7b3dc82b4a0c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:19.261374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e00e3215-f5fd-493c-ab80-7b3dc82b4a0c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:19.407796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e00e3215-f5fd-493c-ab80-7b3dc82b4a0c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:19.416307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e00e3215-f5fd-493c-ab80-7b3dc82b4a0c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.175682 Jul 12 07:18:19.416879 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 318/627] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:19 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:19.593581 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b46d5de6-a105-4e44-af1d-48142f65c336 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:19.594397 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b46d5de6-a105-4e44-af1d-48142f65c336 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:19.604281 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b46d5de6-a105-4e44-af1d-48142f65c336 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:19.604719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b46d5de6-a105-4e44-af1d-48142f65c336 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:19.605532 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b46d5de6-a105-4e44-af1d-48142f65c336 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:19.605953 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b46d5de6-a105-4e44-af1d-48142f65c336 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:20.000054 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b46d5de6-a105-4e44-af1d-48142f65c336 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:20.013401 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b46d5de6-a105-4e44-af1d-48142f65c336 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1690 microversion: 2.1 time: 0.425895 Jul 12 07:18:20.014054 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 319/628] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:19 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1690 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:20.437423 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-528c5adb-2fb3-49f8-aead-4e7daa61ae2e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:20.438501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-528c5adb-2fb3-49f8-aead-4e7daa61ae2e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:20.441354 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=47 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:20.449263 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-528c5adb-2fb3-49f8-aead-4e7daa61ae2e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:20.449702 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-528c5adb-2fb3-49f8-aead-4e7daa61ae2e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:20.450456 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-528c5adb-2fb3-49f8-aead-4e7daa61ae2e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:20.450883 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-528c5adb-2fb3-49f8-aead-4e7daa61ae2e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:20.586132 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-528c5adb-2fb3-49f8-aead-4e7daa61ae2e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:20.594408 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-528c5adb-2fb3-49f8-aead-4e7daa61ae2e tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.163792 Jul 12 07:18:20.594975 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 320/629] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:20 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:21.033620 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e1d0022e-a2fb-4b7f-a9f5-488e4f5a34c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:21.034601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e1d0022e-a2fb-4b7f-a9f5-488e4f5a34c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:21.041722 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1d0022e-a2fb-4b7f-a9f5-488e4f5a34c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:21.042075 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1d0022e-a2fb-4b7f-a9f5-488e4f5a34c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:21.042608 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1d0022e-a2fb-4b7f-a9f5-488e4f5a34c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:21.043021 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1d0022e-a2fb-4b7f-a9f5-488e4f5a34c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:21.181275 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e1d0022e-a2fb-4b7f-a9f5-488e4f5a34c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:21.188850 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e1d0022e-a2fb-4b7f-a9f5-488e4f5a34c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1690 microversion: 2.1 time: 0.159167 Jul 12 07:18:21.189638 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 321/630] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:21 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:21.420862 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ee625ca0-5900-4adb-8978-f5bd0786f621 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.842105 Jul 12 07:18:21.421995 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 310/631] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:18:16 2022] POST /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments => generated 194 bytes in 4844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:21.614033 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3bda6272-861a-4eaa-9d6e-6f07d222e83c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:21.614633 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3bda6272-861a-4eaa-9d6e-6f07d222e83c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:21.620945 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bda6272-861a-4eaa-9d6e-6f07d222e83c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:21.621426 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bda6272-861a-4eaa-9d6e-6f07d222e83c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:21.622178 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bda6272-861a-4eaa-9d6e-6f07d222e83c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:21.622591 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bda6272-861a-4eaa-9d6e-6f07d222e83c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:21.855049 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3bda6272-861a-4eaa-9d6e-6f07d222e83c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:21.862712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3bda6272-861a-4eaa-9d6e-6f07d222e83c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.252373 Jul 12 07:18:21.869215 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 322/632] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:21 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:22.207456 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9e42bab8-86bf-4441-a82d-ac0cd11f0298 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:22.208145 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9e42bab8-86bf-4441-a82d-ac0cd11f0298 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:22.216525 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e42bab8-86bf-4441-a82d-ac0cd11f0298 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:22.217044 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e42bab8-86bf-4441-a82d-ac0cd11f0298 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:22.218259 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e42bab8-86bf-4441-a82d-ac0cd11f0298 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:22.218259 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9e42bab8-86bf-4441-a82d-ac0cd11f0298 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:22.233508 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:22.296617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-9ca4890e-07ff-41c3-9f13-1b5d811a2c98 req-ddadaf44-ccb5-41c9-ace5-95a5e54d957e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59be899b-3595-4b0a-9e4c-969db0bb9c77", "name": "network-vif-deleted", "tag": "713c4298-d251-4d26-895d-e7b0b522105b"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:22.296816 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9e42bab8-86bf-4441-a82d-ac0cd11f0298 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:22.306008 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9e42bab8-86bf-4441-a82d-ac0cd11f0298 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 200 len: 1622 microversion: 2.1 time: 0.102671 Jul 12 07:18:22.307165 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 311/633] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:22 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 1622 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:22.313698 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-9ca4890e-07ff-41c3-9f13-1b5d811a2c98 req-ddadaf44-ccb5-41c9-ace5-95a5e54d957e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:22.321787 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-9ca4890e-07ff-41c3-9f13-1b5d811a2c98 req-ddadaf44-ccb5-41c9-ace5-95a5e54d957e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:22.339011 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-9ca4890e-07ff-41c3-9f13-1b5d811a2c98 req-ddadaf44-ccb5-41c9-ace5-95a5e54d957e service nova] Creating event network-vif-deleted:713c4298-d251-4d26-895d-e7b0b522105b for instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 on hv-cinder-82549 Jul 12 07:18:22.344461 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-9ca4890e-07ff-41c3-9f13-1b5d811a2c98 req-ddadaf44-ccb5-41c9-ace5-95a5e54d957e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051932 Jul 12 07:18:22.348626 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 323/634] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:18:22.536946 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-0005863d-96ed-40f6-a4ff-a293f9494784 req-cee3f74e-c406-47e2-be30-987094d3650e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7ccb04-eb99-4561-9c24-4480c4e0422e", "name": "network-vif-unplugged", "status": "completed", "tag": "696d296b-c149-42d6-896a-50d0d9cc8ad8"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:22.547019 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-0005863d-96ed-40f6-a4ff-a293f9494784 req-cee3f74e-c406-47e2-be30-987094d3650e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:22.547718 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-0005863d-96ed-40f6-a4ff-a293f9494784 req-cee3f74e-c406-47e2-be30-987094d3650e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:22.566007 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.compute.server_external_events [req-0005863d-96ed-40f6-a4ff-a293f9494784 req-cee3f74e-c406-47e2-be30-987094d3650e service nova] Unable to find a host for instance cf7ccb04-eb99-4561-9c24-4480c4e0422e. Dropping event network-vif-unplugged {{(pid=117998) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 07:18:22.567132 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-0005863d-96ed-40f6-a4ff-a293f9494784 req-cee3f74e-c406-47e2-be30-987094d3650e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034922 Jul 12 07:18:22.568533 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 312/635] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 07:18:22.881778 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e1096b6b-91af-4fde-9e66-0086271b7da2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:22.882443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e1096b6b-91af-4fde-9e66-0086271b7da2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:22.890506 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1096b6b-91af-4fde-9e66-0086271b7da2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:22.890951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1096b6b-91af-4fde-9e66-0086271b7da2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:22.891714 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1096b6b-91af-4fde-9e66-0086271b7da2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:22.892142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1096b6b-91af-4fde-9e66-0086271b7da2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:22.894887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:23.043855 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e1096b6b-91af-4fde-9e66-0086271b7da2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:23.052710 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e1096b6b-91af-4fde-9e66-0086271b7da2 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1510 microversion: 2.1 time: 0.175522 Jul 12 07:18:23.053592 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 324/636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:22 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:23.071537 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a373283f-a593-45d4-959c-668b22cc4250 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:23.072247 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a373283f-a593-45d4-959c-668b22cc4250 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:23.079355 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a373283f-a593-45d4-959c-668b22cc4250 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:23.080012 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a373283f-a593-45d4-959c-668b22cc4250 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:23.080888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a373283f-a593-45d4-959c-668b22cc4250 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:23.081601 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a373283f-a593-45d4-959c-668b22cc4250 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:23.169974 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a373283f-a593-45d4-959c-668b22cc4250 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "POST /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e/action" status: 202 len: 0 microversion: 2.1 time: 0.103272 Jul 12 07:18:23.170933 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 313/637] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:18:23 2022] POST /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:18:23.179060 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09190e32-c146-44f3-afe7-bf837987f9ff tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:23.179759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09190e32-c146-44f3-afe7-bf837987f9ff tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:23.186709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09190e32-c146-44f3-afe7-bf837987f9ff tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:23.187437 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09190e32-c146-44f3-afe7-bf837987f9ff tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:23.188427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09190e32-c146-44f3-afe7-bf837987f9ff tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:23.189023 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09190e32-c146-44f3-afe7-bf837987f9ff tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:23.326426 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:23.327040 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 59be899b-3595-4b0a-9e4c-969db0bb9c77] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:23.336387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:23.336876 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:23.337784 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:23.338647 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:23.354038 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] HTTP exception thrown: Instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 could not be found. Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Request method failure captured: Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 HTTP/1.1 Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8LNzVtfwpWAvhiG2VP0p95W_cw9L67Ras80UJ2NEefm-WsWmJD5azfokIEUQefIyUkbJ_7V7fsLEiDZGmTCEF0IneZIGogc__7IY7HGtn2qzESHPoii1lhONc87MT1rgwRsXngi2y59qxPUzaz-EkboDdqOQsCgr6lARNC3J29QuM Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:18:23.357003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02510f7812444c59bec582ff1127aa13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02510f7812444c59bec582ff1127aa13"}]}] Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 7093cc7cf9d1472db33b31e5f98a5141 Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 could not be found. Jul 12 07:18:23.358656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '59be899b-3595-4b0a-9e4c-969db0bb9c77'} Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 could not be found. Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:18:23.359557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 could not be found. Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 could not be found. Jul 12 07:18:23.361085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:23.362434 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Returning 404 to user: Instance 59be899b-3595-4b0a-9e4c-969db0bb9c77 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:18:23.362434 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-95046329-6d36-4463-8da3-ff7163772fd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77" status: 404 len: 111 microversion: 2.1 time: 0.038963 Jul 12 07:18:23.362434 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 314/638] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:23 2022] GET /compute/v2.1/servers/59be899b-3595-4b0a-9e4c-969db0bb9c77 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:18:23.369559 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4ceba924-1df7-45b4-8ddb-6bb233a191c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '.version_select at 0x7f7011684dc0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:23.392028 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4ceba924-1df7-45b4-8ddb-6bb233a191c9 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599832667" status: 202 len: 0 microversion: 2.1 time: 0.027194 Jul 12 07:18:23.393485 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 315/639] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 12 07:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599832667 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 07:18:23.431212 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-09190e32-c146-44f3-afe7-bf837987f9ff tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:23.440111 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09190e32-c146-44f3-afe7-bf837987f9ff tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1518 microversion: 2.1 time: 0.264949 Jul 12 07:18:23.440692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 325/640] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:23 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1518 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:24.458041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e6e05aaa-92a2-48d6-96fe-431b784cc6b8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:24.458743 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e6e05aaa-92a2-48d6-96fe-431b784cc6b8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:24.466612 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e6e05aaa-92a2-48d6-96fe-431b784cc6b8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:24.467054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e6e05aaa-92a2-48d6-96fe-431b784cc6b8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:24.467809 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e6e05aaa-92a2-48d6-96fe-431b784cc6b8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:24.468244 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e6e05aaa-92a2-48d6-96fe-431b784cc6b8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:24.603835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e6e05aaa-92a2-48d6-96fe-431b784cc6b8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:24.611759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e6e05aaa-92a2-48d6-96fe-431b784cc6b8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1520 microversion: 2.1 time: 0.157647 Jul 12 07:18:24.612331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 316/641] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:24 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:25.629936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-228c732c-ef1f-4acf-865c-ef714319e2d9 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:25.630496 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-228c732c-ef1f-4acf-865c-ef714319e2d9 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:25.636754 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-228c732c-ef1f-4acf-865c-ef714319e2d9 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:25.637231 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-228c732c-ef1f-4acf-865c-ef714319e2d9 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:25.638121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-228c732c-ef1f-4acf-865c-ef714319e2d9 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:25.638471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-228c732c-ef1f-4acf-865c-ef714319e2d9 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:25.771367 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-228c732c-ef1f-4acf-865c-ef714319e2d9 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:25.779265 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-228c732c-ef1f-4acf-865c-ef714319e2d9 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1520 microversion: 2.1 time: 0.153349 Jul 12 07:18:25.779826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 326/642] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:25 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:26.408660 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-40ff3e28-ebc0-483b-9d90-0f4cf1f0edd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:26.409568 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-40ff3e28-ebc0-483b-9d90-0f4cf1f0edd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:26.416592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40ff3e28-ebc0-483b-9d90-0f4cf1f0edd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:26.417037 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40ff3e28-ebc0-483b-9d90-0f4cf1f0edd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:26.417790 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40ff3e28-ebc0-483b-9d90-0f4cf1f0edd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:26.419800 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-40ff3e28-ebc0-483b-9d90-0f4cf1f0edd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:26.445838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-40ff3e28-ebc0-483b-9d90-0f4cf1f0edd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:18:26.529782 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-40ff3e28-ebc0-483b-9d90-0f4cf1f0edd1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 204 len: 0 microversion: 2.1 time: 0.124964 Jul 12 07:18:26.530669 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 317/643] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:18:26 2022] DELETE /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:18:26.538758 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8db9a518-75f7-44d3-95e0-7a0e69fbd904 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:26.539355 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8db9a518-75f7-44d3-95e0-7a0e69fbd904 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:26.545367 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8db9a518-75f7-44d3-95e0-7a0e69fbd904 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:26.545803 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8db9a518-75f7-44d3-95e0-7a0e69fbd904 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:26.546573 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8db9a518-75f7-44d3-95e0-7a0e69fbd904 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:26.547001 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8db9a518-75f7-44d3-95e0-7a0e69fbd904 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:26.680571 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8db9a518-75f7-44d3-95e0-7a0e69fbd904 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:26.688578 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8db9a518-75f7-44d3-95e0-7a0e69fbd904 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1508 microversion: 2.1 time: 0.153628 Jul 12 07:18:26.689161 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 327/644] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:26 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:26.797669 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-61e2a4e1-6b70-453f-a20e-29559aab57ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:26.798357 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-61e2a4e1-6b70-453f-a20e-29559aab57ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:26.806761 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61e2a4e1-6b70-453f-a20e-29559aab57ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:26.807206 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61e2a4e1-6b70-453f-a20e-29559aab57ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:26.807944 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61e2a4e1-6b70-453f-a20e-29559aab57ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:26.808376 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-61e2a4e1-6b70-453f-a20e-29559aab57ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:26.959963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-61e2a4e1-6b70-453f-a20e-29559aab57ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:26.968617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-61e2a4e1-6b70-453f-a20e-29559aab57ca tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1520 microversion: 2.1 time: 0.175199 Jul 12 07:18:26.969224 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 318/645] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:26 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:27.710261 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ebad9a7f-4240-4de3-9cfd-f4ab5b29f353 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:27.711234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ebad9a7f-4240-4de3-9cfd-f4ab5b29f353 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:27.721847 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebad9a7f-4240-4de3-9cfd-f4ab5b29f353 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:27.722600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebad9a7f-4240-4de3-9cfd-f4ab5b29f353 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:27.723846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebad9a7f-4240-4de3-9cfd-f4ab5b29f353 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:27.724562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebad9a7f-4240-4de3-9cfd-f4ab5b29f353 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:27.870527 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ebad9a7f-4240-4de3-9cfd-f4ab5b29f353 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:27.878394 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ebad9a7f-4240-4de3-9cfd-f4ab5b29f353 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1508 microversion: 2.1 time: 0.174665 Jul 12 07:18:27.878970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 328/646] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:27 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:27.994796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ef92711d-64d3-41fb-abb3-f6a22dccc08d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:27.994796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ef92711d-64d3-41fb-abb3-f6a22dccc08d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:27.999839 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ef92711d-64d3-41fb-abb3-f6a22dccc08d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:28.000284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ef92711d-64d3-41fb-abb3-f6a22dccc08d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:28.001077 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ef92711d-64d3-41fb-abb3-f6a22dccc08d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:28.001522 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ef92711d-64d3-41fb-abb3-f6a22dccc08d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:28.133258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ef92711d-64d3-41fb-abb3-f6a22dccc08d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:28.146996 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ef92711d-64d3-41fb-abb3-f6a22dccc08d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1520 microversion: 2.1 time: 0.163790 Jul 12 07:18:28.147855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 319/647] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:27 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:28.902887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8d7584ea-6c37-43f3-a580-398d2d98c9cc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:28.903501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8d7584ea-6c37-43f3-a580-398d2d98c9cc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:28.910303 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d7584ea-6c37-43f3-a580-398d2d98c9cc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:28.910763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d7584ea-6c37-43f3-a580-398d2d98c9cc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:28.911514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d7584ea-6c37-43f3-a580-398d2d98c9cc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:28.911933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d7584ea-6c37-43f3-a580-398d2d98c9cc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:29.052635 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8d7584ea-6c37-43f3-a580-398d2d98c9cc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:29.061242 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8d7584ea-6c37-43f3-a580-398d2d98c9cc tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1508 microversion: 2.1 time: 0.165229 Jul 12 07:18:29.061816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 329/648] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:28 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:29.168888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8ea121c7-e70a-4208-97a9-c04ab90908c8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:29.169669 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8ea121c7-e70a-4208-97a9-c04ab90908c8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:29.177589 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ea121c7-e70a-4208-97a9-c04ab90908c8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:29.178110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ea121c7-e70a-4208-97a9-c04ab90908c8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:29.178991 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ea121c7-e70a-4208-97a9-c04ab90908c8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:29.179497 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8ea121c7-e70a-4208-97a9-c04ab90908c8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:29.320222 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8ea121c7-e70a-4208-97a9-c04ab90908c8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:29.327916 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8ea121c7-e70a-4208-97a9-c04ab90908c8 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1520 microversion: 2.1 time: 0.165477 Jul 12 07:18:29.328482 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 320/649] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:29 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:30.071713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbe5314f-a639-47e8-a121-2d9263201334"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:30.073487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:30.078341 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-23130d47-f9d4-4326-a79e-4af0e7c82d7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:30.079039 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-23130d47-f9d4-4326-a79e-4af0e7c82d7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:30.080073 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.080481 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.081490 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.081912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.085165 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23130d47-f9d4-4326-a79e-4af0e7c82d7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.085645 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23130d47-f9d4-4326-a79e-4af0e7c82d7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.086369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23130d47-f9d4-4326-a79e-4af0e7c82d7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.086803 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23130d47-f9d4-4326-a79e-4af0e7c82d7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.165904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Invalid volume: volume bbe5314f-a639-47e8-a121-2d9263201334 is already attached to instances: f428539a-0743-4d98-889b-0c2e7f7ae5ca Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: POST /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments HTTP/1.1 Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 74 Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:18:30.167658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {"volumeAttachment": {"volumeId": "bbe5314f-a639-47e8-a121-2d9263201334"}} Jul 12 07:18:30.169699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Invalid volume: volume bbe5314f-a639-47e8-a121-2d9263201334 is already attached to instances: f428539a-0743-4d98-889b-0c2e7f7ae5ca Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'server_id': 'f428539a-0743-4d98-889b-0c2e7f7ae5ca', 'body': {'volumeAttachment': {'volumeId': 'bbe5314f-a639-47e8-a121-2d9263201334'}}} Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bbe5314f-a639-47e8-a121-2d9263201334 is already attached to instances: f428539a-0743-4d98-889b-0c2e7f7ae5ca Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:18:30.170904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bbe5314f-a639-47e8-a121-2d9263201334 is already attached to instances: f428539a-0743-4d98-889b-0c2e7f7ae5ca Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:30.172225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:30.173683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:30.173683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:18:30.173683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:18:30.173683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bbe5314f-a639-47e8-a121-2d9263201334 is already attached to instances: f428539a-0743-4d98-889b-0c2e7f7ae5ca Jul 12 07:18:30.173683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:18:30.173683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 400 to user: Invalid volume: volume bbe5314f-a639-47e8-a121-2d9263201334 is already attached to instances: f428539a-0743-4d98-889b-0c2e7f7ae5ca {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:18:30.173683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2f9e8357-936e-4d2a-8740-aff975081f83 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101720 Jul 12 07:18:30.173683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 330/650] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:18:30 2022] POST /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:18:30.231802 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fc2482cd-424c-4b9c-9be7-2c9973b70f8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:30.232276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fc2482cd-424c-4b9c-9be7-2c9973b70f8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:30.239584 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc2482cd-424c-4b9c-9be7-2c9973b70f8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.239998 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc2482cd-424c-4b9c-9be7-2c9973b70f8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.240757 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc2482cd-424c-4b9c-9be7-2c9973b70f8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.241220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc2482cd-424c-4b9c-9be7-2c9973b70f8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.298940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-23130d47-f9d4-4326-a79e-4af0e7c82d7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:30.334716 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-23130d47-f9d4-4326-a79e-4af0e7c82d7f tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1508 microversion: 2.1 time: 0.260478 Jul 12 07:18:30.335230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 321/651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:30 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:18:30.337623 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-fc2482cd-424c-4b9c-9be7-2c9973b70f8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lazy-loading 'services' on Instance uuid f428539a-0743-4d98-889b-0c2e7f7ae5ca {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:18:30.350679 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6ef0e626-2f78-4505-9947-b9574ba89eb7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:30.351278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6ef0e626-2f78-4505-9947-b9574ba89eb7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:30.358753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ef0e626-2f78-4505-9947-b9574ba89eb7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.359196 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ef0e626-2f78-4505-9947-b9574ba89eb7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.360662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ef0e626-2f78-4505-9947-b9574ba89eb7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.361024 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6ef0e626-2f78-4505-9947-b9574ba89eb7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.425676 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fc2482cd-424c-4b9c-9be7-2c9973b70f8f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments/bbe5314f-a639-47e8-a121-2d9263201334" status: 202 len: 0 microversion: 2.1 time: 0.197648 Jul 12 07:18:30.426832 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 331/652] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:18:30 2022] DELETE /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments/bbe5314f-a639-47e8-a121-2d9263201334 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 07:18:30.440497 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fbf0eac6-d4e2-4414-9895-b80d551e046c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:30.442824 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fbf0eac6-d4e2-4414-9895-b80d551e046c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:30.453978 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf0eac6-d4e2-4414-9895-b80d551e046c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.455740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf0eac6-d4e2-4414-9895-b80d551e046c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.456960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf0eac6-d4e2-4414-9895-b80d551e046c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.457583 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf0eac6-d4e2-4414-9895-b80d551e046c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.516198 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fbf0eac6-d4e2-4414-9895-b80d551e046c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084838 Jul 12 07:18:30.521199 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 332/653] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:18:30 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:18:30.527225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-2ee4c974-034b-4e60-97ee-2170ff47e256 req-56b493ac-ab29-49ae-b845-13e7c1fba10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a100f3-9f55-417b-b3c6-42ca96d65d76", "name": "network-vif-deleted", "tag": "1ed4c67e-98fe-48ca-9c55-208d67325841"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:30.547653 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-2ee4c974-034b-4e60-97ee-2170ff47e256 req-56b493ac-ab29-49ae-b845-13e7c1fba10a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:30.548437 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-2ee4c974-034b-4e60-97ee-2170ff47e256 req-56b493ac-ab29-49ae-b845-13e7c1fba10a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:30.562744 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-2ee4c974-034b-4e60-97ee-2170ff47e256 req-56b493ac-ab29-49ae-b845-13e7c1fba10a service nova] Creating event network-vif-deleted:1ed4c67e-98fe-48ca-9c55-208d67325841 for instance c8a100f3-9f55-417b-b3c6-42ca96d65d76 on hv-cinder-82549 Jul 12 07:18:30.568270 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-2ee4c974-034b-4e60-97ee-2170ff47e256 req-56b493ac-ab29-49ae-b845-13e7c1fba10a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044843 Jul 12 07:18:30.569008 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 333/654] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:30.574303 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6ef0e626-2f78-4505-9947-b9574ba89eb7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:30.582617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6ef0e626-2f78-4505-9947-b9574ba89eb7 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1520 microversion: 2.1 time: 0.235780 Jul 12 07:18:30.585475 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 322/655] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:30 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:18:31.354222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:31.354947 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:31.362687 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:31.363121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:31.363873 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:31.364299 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:31.398281 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:31.398281 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:31.398818 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lazy-loading 'fault' on Instance uuid c8a100f3-9f55-417b-b3c6-42ca96d65d76 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:18:31.446061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:31.454666 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bc057077-e43c-419c-a6c5-745f85285898 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 200 len: 1312 microversion: 2.1 time: 0.105593 Jul 12 07:18:31.455239 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 334/656] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:31 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:31.535142 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8d99949c-d628-46f4-8c88-9a197e06c7a6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:31.537816 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8d99949c-d628-46f4-8c88-9a197e06c7a6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:31.550917 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d99949c-d628-46f4-8c88-9a197e06c7a6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:31.557650 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d99949c-d628-46f4-8c88-9a197e06c7a6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:31.557650 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d99949c-d628-46f4-8c88-9a197e06c7a6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:31.557650 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8d99949c-d628-46f4-8c88-9a197e06c7a6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:31.600608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8d99949c-d628-46f4-8c88-9a197e06c7a6 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074640 Jul 12 07:18:31.601496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 323/657] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:18:31 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:31.601984 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-607692e7-ca50-453b-b889-d86c442aad1d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:31.602846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-607692e7-ca50-453b-b889-d86c442aad1d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:31.609093 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-607692e7-ca50-453b-b889-d86c442aad1d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:31.609864 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-607692e7-ca50-453b-b889-d86c442aad1d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:31.610633 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-607692e7-ca50-453b-b889-d86c442aad1d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:31.611067 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-607692e7-ca50-453b-b889-d86c442aad1d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:31.750688 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-607692e7-ca50-453b-b889-d86c442aad1d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:31.759420 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-607692e7-ca50-453b-b889-d86c442aad1d tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.162133 Jul 12 07:18:31.760172 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 335/658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:31 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:32.472404 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:32.473010 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: c8a100f3-9f55-417b-b3c6-42ca96d65d76] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:32.479800 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.480418 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.481230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.481661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.495766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] HTTP exception thrown: Instance c8a100f3-9f55-417b-b3c6-42ca96d65d76 could not be found. Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Request method failure captured: Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 HTTP/1.1 Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8LNzVtfwpWAvhiG2VP0p95W_cw9L67Ras80UJ2NEefm-WsWmJD5azfokIEUQefIyUkbJ_7V7fsLEiDZGmTCEF0IneZIGogc__7IY7HGtn2qzESHPoii1lhONc87MT1rgwRsXngi2y59qxPUzaz-EkboDdqOQsCgr6lARNC3J29QuM Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:18:32.497445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02510f7812444c59bec582ff1127aa13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02510f7812444c59bec582ff1127aa13"}]}] Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 7093cc7cf9d1472db33b31e5f98a5141 Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance c8a100f3-9f55-417b-b3c6-42ca96d65d76 could not be found. Jul 12 07:18:32.498956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'c8a100f3-9f55-417b-b3c6-42ca96d65d76'} Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8a100f3-9f55-417b-b3c6-42ca96d65d76 could not be found. Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:18:32.499897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8a100f3-9f55-417b-b3c6-42ca96d65d76 could not be found. Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8a100f3-9f55-417b-b3c6-42ca96d65d76 could not be found. Jul 12 07:18:32.501545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:32.503274 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Returning 404 to user: Instance c8a100f3-9f55-417b-b3c6-42ca96d65d76 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:18:32.503274 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e99e19ea-12a5-459b-9716-860e6a31ae17 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76" status: 404 len: 111 microversion: 2.1 time: 0.030674 Jul 12 07:18:32.503274 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 324/659] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:32 2022] GET /compute/v2.1/servers/c8a100f3-9f55-417b-b3c6-42ca96d65d76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:18:32.508208 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7533afac-dba1-4b22-9acc-57f5cd0ffcdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:32.508704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7533afac-dba1-4b22-9acc-57f5cd0ffcdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:32.515183 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7533afac-dba1-4b22-9acc-57f5cd0ffcdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.515690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7533afac-dba1-4b22-9acc-57f5cd0ffcdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.516531 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7533afac-dba1-4b22-9acc-57f5cd0ffcdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.517017 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7533afac-dba1-4b22-9acc-57f5cd0ffcdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.543854 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7533afac-dba1-4b22-9acc-57f5cd0ffcdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:18:32.612019 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b6205367-94f6-4a30-a346-8bd1eaf18820 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:32.612931 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b6205367-94f6-4a30-a346-8bd1eaf18820 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:32.619881 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b6205367-94f6-4a30-a346-8bd1eaf18820 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.620325 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b6205367-94f6-4a30-a346-8bd1eaf18820 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.621106 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b6205367-94f6-4a30-a346-8bd1eaf18820 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.621529 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b6205367-94f6-4a30-a346-8bd1eaf18820 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.622544 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7533afac-dba1-4b22-9acc-57f5cd0ffcdb tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 204 len: 0 microversion: 2.1 time: 0.117960 Jul 12 07:18:32.623131 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 336/660] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:18:32 2022] DELETE /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:18:32.631773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aafd8b6b-d402-4671-aa49-e3b46ec9cf4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:32.632465 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aafd8b6b-d402-4671-aa49-e3b46ec9cf4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:32.638539 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aafd8b6b-d402-4671-aa49-e3b46ec9cf4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.639054 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aafd8b6b-d402-4671-aa49-e3b46ec9cf4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.639812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aafd8b6b-d402-4671-aa49-e3b46ec9cf4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.640234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aafd8b6b-d402-4671-aa49-e3b46ec9cf4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.651093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b6205367-94f6-4a30-a346-8bd1eaf18820 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043138 Jul 12 07:18:32.651643 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 325/661] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:18:32 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:18:32.709312 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ad7333f6-7f29-41d6-8baa-fe40a2464da1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:32.709722 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ad7333f6-7f29-41d6-8baa-fe40a2464da1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:32.715718 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad7333f6-7f29-41d6-8baa-fe40a2464da1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.716153 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad7333f6-7f29-41d6-8baa-fe40a2464da1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.716909 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad7333f6-7f29-41d6-8baa-fe40a2464da1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.717352 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ad7333f6-7f29-41d6-8baa-fe40a2464da1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.743711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ad7333f6-7f29-41d6-8baa-fe40a2464da1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:18:32.779023 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aafd8b6b-d402-4671-aa49-e3b46ec9cf4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:32.787861 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aafd8b6b-d402-4671-aa49-e3b46ec9cf4d tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.160053 Jul 12 07:18:32.788432 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 337/662] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:32 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:32.793229 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a16d304b-6813-4920-8283-4e0389a66425 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:32.793831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a16d304b-6813-4920-8283-4e0389a66425 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:32.794728 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:32.800464 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a16d304b-6813-4920-8283-4e0389a66425 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.800910 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a16d304b-6813-4920-8283-4e0389a66425 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.801866 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a16d304b-6813-4920-8283-4e0389a66425 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.802273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a16d304b-6813-4920-8283-4e0389a66425 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.824612 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ad7333f6-7f29-41d6-8baa-fe40a2464da1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 204 len: 0 microversion: 2.1 time: 0.118868 Jul 12 07:18:32.825236 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 326/663] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:18:32 2022] DELETE /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 07:18:32.834405 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b7d8a835-c7b3-47ec-b321-5f8cecfd9846 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:32.835110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b7d8a835-c7b3-47ec-b321-5f8cecfd9846 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:32.841678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7d8a835-c7b3-47ec-b321-5f8cecfd9846 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.842132 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7d8a835-c7b3-47ec-b321-5f8cecfd9846 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.842892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7d8a835-c7b3-47ec-b321-5f8cecfd9846 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:32.843330 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7d8a835-c7b3-47ec-b321-5f8cecfd9846 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:32.987061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a16d304b-6813-4920-8283-4e0389a66425 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:32.989781 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:32.997380 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a16d304b-6813-4920-8283-4e0389a66425 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.207631 Jul 12 07:18:32.998152 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 338/664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:32 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:33.018678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b7d8a835-c7b3-47ec-b321-5f8cecfd9846 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:33.026315 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b7d8a835-c7b3-47ec-b321-5f8cecfd9846 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1681 microversion: 2.1 time: 0.196145 Jul 12 07:18:33.026875 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 327/665] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:32 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:33.703777 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6ca1d485-836d-4d66-b484-f949cfb0cbd4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:33.704314 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6ca1d485-836d-4d66-b484-f949cfb0cbd4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:33.710864 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ca1d485-836d-4d66-b484-f949cfb0cbd4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:33.711304 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ca1d485-836d-4d66-b484-f949cfb0cbd4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:33.712061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ca1d485-836d-4d66-b484-f949cfb0cbd4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:33.712516 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ca1d485-836d-4d66-b484-f949cfb0cbd4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:33.740314 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6ca1d485-836d-4d66-b484-f949cfb0cbd4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/ips" status: 200 len: 153 microversion: 2.20 time: 0.108475 Jul 12 07:18:33.740894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 339/666] 10.222.0.25 () {60 vars in 1288 bytes} [Tue Jul 12 07:18:33 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/ips => generated 153 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:18:33.805549 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e94c4e3c-83a5-4d06-bbbd-964868bc5648 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:33.806395 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e94c4e3c-83a5-4d06-bbbd-964868bc5648 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:33.814355 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e94c4e3c-83a5-4d06-bbbd-964868bc5648 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:33.815025 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e94c4e3c-83a5-4d06-bbbd-964868bc5648 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:33.815793 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e94c4e3c-83a5-4d06-bbbd-964868bc5648 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:33.816220 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e94c4e3c-83a5-4d06-bbbd-964868bc5648 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:33.952162 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e94c4e3c-83a5-4d06-bbbd-964868bc5648 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:33.962041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e94c4e3c-83a5-4d06-bbbd-964868bc5648 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.160842 Jul 12 07:18:33.962994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 328/667] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:33 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:34.015142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c5d559d8-b3d8-4f1d-97b8-6b8f18ee01be tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:34.015999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c5d559d8-b3d8-4f1d-97b8-6b8f18ee01be tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:34.025303 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5d559d8-b3d8-4f1d-97b8-6b8f18ee01be tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:34.025750 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5d559d8-b3d8-4f1d-97b8-6b8f18ee01be tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:34.027417 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5d559d8-b3d8-4f1d-97b8-6b8f18ee01be tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:34.027856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5d559d8-b3d8-4f1d-97b8-6b8f18ee01be tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:34.043609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-44778bd2-7e47-4b00-8bab-10bcb5acf916 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:34.044324 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-44778bd2-7e47-4b00-8bab-10bcb5acf916 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:34.050587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-44778bd2-7e47-4b00-8bab-10bcb5acf916 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:34.051255 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-44778bd2-7e47-4b00-8bab-10bcb5acf916 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:34.052024 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-44778bd2-7e47-4b00-8bab-10bcb5acf916 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:34.052456 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-44778bd2-7e47-4b00-8bab-10bcb5acf916 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:34.230102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c5d559d8-b3d8-4f1d-97b8-6b8f18ee01be tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:34.234620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-44778bd2-7e47-4b00-8bab-10bcb5acf916 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:34.239699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c5d559d8-b3d8-4f1d-97b8-6b8f18ee01be tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.228735 Jul 12 07:18:34.240385 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 340/668] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:34 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:34.243539 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-44778bd2-7e47-4b00-8bab-10bcb5acf916 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1681 microversion: 2.1 time: 0.203723 Jul 12 07:18:34.244108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 329/669] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:34 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:18:34.983207 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4ac44f43-3f52-4817-aad9-4b1df30e3357 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:34.984156 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4ac44f43-3f52-4817-aad9-4b1df30e3357 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:34.991991 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ac44f43-3f52-4817-aad9-4b1df30e3357 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:34.992440 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ac44f43-3f52-4817-aad9-4b1df30e3357 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:34.993233 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ac44f43-3f52-4817-aad9-4b1df30e3357 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:34.993667 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ac44f43-3f52-4817-aad9-4b1df30e3357 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:35.134253 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4ac44f43-3f52-4817-aad9-4b1df30e3357 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:35.144868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4ac44f43-3f52-4817-aad9-4b1df30e3357 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.168286 Jul 12 07:18:35.145475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 341/670] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:34 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:35.258994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-434ee785-090e-4819-ad51-e8896c9c1304 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:35.259655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-434ee785-090e-4819-ad51-e8896c9c1304 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:35.261677 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-265f8491-c35b-48c9-8050-e59fe722b8de tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:35.262464 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-265f8491-c35b-48c9-8050-e59fe722b8de tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:35.263004 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:35.270228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-434ee785-090e-4819-ad51-e8896c9c1304 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:35.270409 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-265f8491-c35b-48c9-8050-e59fe722b8de tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:35.270665 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-265f8491-c35b-48c9-8050-e59fe722b8de tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:35.270818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-434ee785-090e-4819-ad51-e8896c9c1304 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:35.271437 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-265f8491-c35b-48c9-8050-e59fe722b8de tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:35.271573 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-434ee785-090e-4819-ad51-e8896c9c1304 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:35.271849 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-265f8491-c35b-48c9-8050-e59fe722b8de tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:35.272086 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-434ee785-090e-4819-ad51-e8896c9c1304 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:35.472536 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-265f8491-c35b-48c9-8050-e59fe722b8de tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:35.477553 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-434ee785-090e-4819-ad51-e8896c9c1304 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:35.484293 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-265f8491-c35b-48c9-8050-e59fe722b8de tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1681 microversion: 2.1 time: 0.227577 Jul 12 07:18:35.485213 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 342/671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:35 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:35.489678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-434ee785-090e-4819-ad51-e8896c9c1304 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.235640 Jul 12 07:18:35.490638 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 330/672] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:35 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:35.794104 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09b046dc-c9b0-4c64-8aa4-1b5d038b9cc0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:35.794779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09b046dc-c9b0-4c64-8aa4-1b5d038b9cc0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:35.802433 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09b046dc-c9b0-4c64-8aa4-1b5d038b9cc0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:35.802871 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09b046dc-c9b0-4c64-8aa4-1b5d038b9cc0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:35.803619 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09b046dc-c9b0-4c64-8aa4-1b5d038b9cc0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:35.804040 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09b046dc-c9b0-4c64-8aa4-1b5d038b9cc0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:35.826816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-09b046dc-c9b0-4c64-8aa4-1b5d038b9cc0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lazy-loading 'flavor' on Instance uuid db8a7f04-501d-4547-b7ca-9e19f7d59c32 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:18:36.101927 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09b046dc-c9b0-4c64-8aa4-1b5d038b9cc0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/action" status: 202 len: 0 microversion: 2.20 time: 0.312642 Jul 12 07:18:36.102573 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 343/673] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 12 07:18:35 2022] POST /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:18:36.110914 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:36.111508 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:36.118107 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:36.118546 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:36.119298 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:36.119724 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:36.163046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-387eb441-0eb3-44d7-8b80-8d459bc1f61a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:36.163743 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-387eb441-0eb3-44d7-8b80-8d459bc1f61a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:36.170508 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-387eb441-0eb3-44d7-8b80-8d459bc1f61a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:36.170949 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-387eb441-0eb3-44d7-8b80-8d459bc1f61a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:36.171709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-387eb441-0eb3-44d7-8b80-8d459bc1f61a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:36.172144 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-387eb441-0eb3-44d7-8b80-8d459bc1f61a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:36.300804 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:36.309726 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:36.311349 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:36.312583 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3601c8ef-46ad-436d-809f-0ab8de83b877 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.205644 Jul 12 07:18:36.313205 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 331/674] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:36 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:36.329469 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-387eb441-0eb3-44d7-8b80-8d459bc1f61a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:36.337555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-387eb441-0eb3-44d7-8b80-8d459bc1f61a tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.179191 Jul 12 07:18:36.338044 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 344/675] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:36 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:36.509040 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f30b5044-137b-420a-9bdb-5e2e2c84d5e9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:36.509847 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f30b5044-137b-420a-9bdb-5e2e2c84d5e9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:36.513572 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-db0e4122-22e8-4bc8-b6e9-a93245489905 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:36.513794 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-db0e4122-22e8-4bc8-b6e9-a93245489905 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:36.518366 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f30b5044-137b-420a-9bdb-5e2e2c84d5e9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:36.518799 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f30b5044-137b-420a-9bdb-5e2e2c84d5e9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:36.519577 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f30b5044-137b-420a-9bdb-5e2e2c84d5e9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:36.520019 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f30b5044-137b-420a-9bdb-5e2e2c84d5e9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:36.521181 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db0e4122-22e8-4bc8-b6e9-a93245489905 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:36.521618 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db0e4122-22e8-4bc8-b6e9-a93245489905 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:36.522374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db0e4122-22e8-4bc8-b6e9-a93245489905 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:36.522796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db0e4122-22e8-4bc8-b6e9-a93245489905 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:36.952521 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f30b5044-137b-420a-9bdb-5e2e2c84d5e9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:36.956619 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-db0e4122-22e8-4bc8-b6e9-a93245489905 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:36.960472 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f30b5044-137b-420a-9bdb-5e2e2c84d5e9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1681 microversion: 2.1 time: 0.456267 Jul 12 07:18:36.961088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 332/676] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:36 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1681 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:36.964552 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-db0e4122-22e8-4bc8-b6e9-a93245489905 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.456323 Jul 12 07:18:36.965165 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 345/677] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:36 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:37.334797 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:37.335567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:37.345730 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:37.346433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:37.347840 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:37.348414 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:37.356673 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a66391fe-ccd6-48ad-ada0-a31a885c12ca tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:37.357489 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a66391fe-ccd6-48ad-ada0-a31a885c12ca tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:37.365165 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a66391fe-ccd6-48ad-ada0-a31a885c12ca tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:37.365601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a66391fe-ccd6-48ad-ada0-a31a885c12ca tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:37.366352 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a66391fe-ccd6-48ad-ada0-a31a885c12ca tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:37.366774 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a66391fe-ccd6-48ad-ada0-a31a885c12ca tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:37.554544 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:37.561202 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a66391fe-ccd6-48ad-ada0-a31a885c12ca tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:37.562944 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:37.564439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:37.565718 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2f923fa2-dc90-4c45-86d3-1158364c85f3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.236973 Jul 12 07:18:37.566282 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 333/678] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:37 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:37.568974 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a66391fe-ccd6-48ad-ada0-a31a885c12ca tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.217470 Jul 12 07:18:37.569567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 346/679] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:37 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:37.982227 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-84bc2859-5de8-4d48-aa4c-18a8545fa384 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:37.983245 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-84bc2859-5de8-4d48-aa4c-18a8545fa384 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:37.987032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-77a381bd-67ca-43e9-bae2-d0bf8fcdc565 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:37.991747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-77a381bd-67ca-43e9-bae2-d0bf8fcdc565 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:37.991899 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84bc2859-5de8-4d48-aa4c-18a8545fa384 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:37.991899 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84bc2859-5de8-4d48-aa4c-18a8545fa384 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:37.992121 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84bc2859-5de8-4d48-aa4c-18a8545fa384 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:37.992464 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-84bc2859-5de8-4d48-aa4c-18a8545fa384 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:37.994093 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77a381bd-67ca-43e9-bae2-d0bf8fcdc565 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:37.995049 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77a381bd-67ca-43e9-bae2-d0bf8fcdc565 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:37.995824 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77a381bd-67ca-43e9-bae2-d0bf8fcdc565 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:37.997696 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77a381bd-67ca-43e9-bae2-d0bf8fcdc565 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:38.189283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-84bc2859-5de8-4d48-aa4c-18a8545fa384 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:38.193002 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-77a381bd-67ca-43e9-bae2-d0bf8fcdc565 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:38.197077 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-84bc2859-5de8-4d48-aa4c-18a8545fa384 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1681 microversion: 2.1 time: 0.221596 Jul 12 07:18:38.197651 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 334/680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:37 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:38.201231 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-77a381bd-67ca-43e9-bae2-d0bf8fcdc565 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.220991 Jul 12 07:18:38.201803 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 347/681] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:37 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:38.588986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:38.589976 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-051f8a51-50e4-4b1e-ac8b-cabd57bfef99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:38.590586 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:38.590746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-051f8a51-50e4-4b1e-ac8b-cabd57bfef99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:38.599592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:38.599957 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-051f8a51-50e4-4b1e-ac8b-cabd57bfef99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:38.600351 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:38.600589 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-051f8a51-50e4-4b1e-ac8b-cabd57bfef99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:38.601339 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:38.601573 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:38.601811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-051f8a51-50e4-4b1e-ac8b-cabd57bfef99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:38.602315 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-051f8a51-50e4-4b1e-ac8b-cabd57bfef99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:38.800064 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:38.803245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-051f8a51-50e4-4b1e-ac8b-cabd57bfef99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:38.808434 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:38.809950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:38.811016 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-051f8a51-50e4-4b1e-ac8b-cabd57bfef99 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1523 microversion: 2.1 time: 0.227968 Jul 12 07:18:38.811184 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1ffb1ef3-9093-406a-bb6a-2b4ac76e34dc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.228908 Jul 12 07:18:38.811884 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 335/683] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:38 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:38.812029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 348/683] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:38 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:39.216045 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-379c2e67-0b04-4cf8-8978-0800fb62abf1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:39.216652 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-379c2e67-0b04-4cf8-8978-0800fb62abf1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:39.218999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-94081518-5618-43c7-9e5d-b45eea164888 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:39.220042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-94081518-5618-43c7-9e5d-b45eea164888 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:39.223568 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-379c2e67-0b04-4cf8-8978-0800fb62abf1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:39.224016 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-379c2e67-0b04-4cf8-8978-0800fb62abf1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:39.224763 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-379c2e67-0b04-4cf8-8978-0800fb62abf1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:39.225215 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-379c2e67-0b04-4cf8-8978-0800fb62abf1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:39.226179 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94081518-5618-43c7-9e5d-b45eea164888 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:39.226614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94081518-5618-43c7-9e5d-b45eea164888 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:39.227360 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94081518-5618-43c7-9e5d-b45eea164888 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:39.227970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94081518-5618-43c7-9e5d-b45eea164888 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:39.626199 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-94081518-5618-43c7-9e5d-b45eea164888 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:39.634615 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-94081518-5618-43c7-9e5d-b45eea164888 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.420233 Jul 12 07:18:39.635193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 349/684] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:39 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:39.668735 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-379c2e67-0b04-4cf8-8978-0800fb62abf1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:39.676624 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-379c2e67-0b04-4cf8-8978-0800fb62abf1 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1681 microversion: 2.1 time: 0.466038 Jul 12 07:18:39.677510 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 336/685] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:39 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1681 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:39.833918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e22b168f-4aa1-4dcf-a3ae-5cf8bbd02ea1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:39.834141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e22b168f-4aa1-4dcf-a3ae-5cf8bbd02ea1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:39.838899 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:39.839516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:39.847958 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e22b168f-4aa1-4dcf-a3ae-5cf8bbd02ea1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:39.848393 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e22b168f-4aa1-4dcf-a3ae-5cf8bbd02ea1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:39.849451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e22b168f-4aa1-4dcf-a3ae-5cf8bbd02ea1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:39.849617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e22b168f-4aa1-4dcf-a3ae-5cf8bbd02ea1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:39.851868 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:39.852339 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:39.853126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:39.855835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:39.947409 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e22b168f-4aa1-4dcf-a3ae-5cf8bbd02ea1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093cc7cf9d1472db33b31e5f98a5141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02510f7812444c59bec582ff1127aa13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:39.956209 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e22b168f-4aa1-4dcf-a3ae-5cf8bbd02ea1 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 200 len: 1481 microversion: 2.1 time: 0.132173 Jul 12 07:18:39.956783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 350/686] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:39 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 1481 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:40.036136 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-32ee5cfa-012f-400d-8c97-370d4251c02f req-5ce20a30-e953-4cb5-a995-2e33877b9cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eae86e1-220e-41f6-9b8d-7b5a224f7a89", "name": "network-vif-deleted", "tag": "7382a006-1c5b-424d-a60a-2f13d664f229"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:40.044872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-32ee5cfa-012f-400d-8c97-370d4251c02f req-5ce20a30-e953-4cb5-a995-2e33877b9cd5 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:40.045434 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-32ee5cfa-012f-400d-8c97-370d4251c02f req-5ce20a30-e953-4cb5-a995-2e33877b9cd5 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:40.056836 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-32ee5cfa-012f-400d-8c97-370d4251c02f req-5ce20a30-e953-4cb5-a995-2e33877b9cd5 service nova] Creating event network-vif-deleted:7382a006-1c5b-424d-a60a-2f13d664f229 for instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 on hv-cinder-82549 Jul 12 07:18:40.066261 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-32ee5cfa-012f-400d-8c97-370d4251c02f req-5ce20a30-e953-4cb5-a995-2e33877b9cd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103151 Jul 12 07:18:40.067120 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 351/687] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:40.147134 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:40.155243 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:40.156742 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:40.157922 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e8ebca34-e35f-4db5-9631-df93877446be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.323585 Jul 12 07:18:40.158991 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 337/688] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:39 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:40.652944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e1c95340-ad65-45c1-b472-aacd8fc75932 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:40.653658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e1c95340-ad65-45c1-b472-aacd8fc75932 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:40.661284 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1c95340-ad65-45c1-b472-aacd8fc75932 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:40.661671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1c95340-ad65-45c1-b472-aacd8fc75932 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:40.662442 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1c95340-ad65-45c1-b472-aacd8fc75932 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:40.662871 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1c95340-ad65-45c1-b472-aacd8fc75932 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:40.696678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:40.698187 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:40.709015 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:40.709633 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:40.710563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:40.711653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:40.752626 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:40.753069 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:40.753599 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lazy-loading 'fault' on Instance uuid f428539a-0743-4d98-889b-0c2e7f7ae5ca {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:18:40.822009 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:40.829817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-65305f1c-adf7-45a1-a8b0-82f1471e0f58 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 200 len: 1331 microversion: 2.1 time: 0.137598 Jul 12 07:18:40.830427 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 338/689] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:40 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:40.841500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e1c95340-ad65-45c1-b472-aacd8fc75932 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:40.849548 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e1c95340-ad65-45c1-b472-aacd8fc75932 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.201337 Jul 12 07:18:40.850561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 352/690] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:40 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:40.974839 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:40.975442 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] [instance: 2eae86e1-220e-41f6-9b8d-7b5a224f7a89] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:40.986200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:40.995569 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:40.996758 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:40.997462 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:41.026600 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] HTTP exception thrown: Instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 could not be found. Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Request method failure captured: Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 HTTP/1.1 Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8LNzVtfwpWAvhiG2VP0p95W_cw9L67Ras80UJ2NEefm-WsWmJD5azfokIEUQefIyUkbJ_7V7fsLEiDZGmTCEF0IneZIGogc__7IY7HGtn2qzESHPoii1lhONc87MT1rgwRsXngi2y59qxPUzaz-EkboDdqOQsCgr6lARNC3J29QuM Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:18:41.028265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/02510f7812444c59bec582ff1127aa13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_02510f7812444c59bec582ff1127aa13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/02510f7812444c59bec582ff1127aa13"}]}] Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 02510f7812444c59bec582ff1127aa13 Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1981048929 Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 7093cc7cf9d1472db33b31e5f98a5141 Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1981048929-project Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 could not be found. Jul 12 07:18:41.029675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '2eae86e1-220e-41f6-9b8d-7b5a224f7a89'} Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 could not be found. Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:18:41.030433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 could not be found. Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 could not be found. Jul 12 07:18:41.031608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.032667 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] Returning 404 to user: Instance 2eae86e1-220e-41f6-9b8d-7b5a224f7a89 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:18:41.032667 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3ef29825-37de-4b88-b870-5df16563fb88 tempest-ServerRescueNegativeTestJSON-1981048929 tempest-ServerRescueNegativeTestJSON-1981048929-project] 10.222.0.25 "GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89" status: 404 len: 111 microversion: 2.1 time: 0.060594 Jul 12 07:18:41.032667 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 339/691] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:40 2022] GET /compute/v2.1/servers/2eae86e1-220e-41f6-9b8d-7b5a224f7a89 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:18:41.176193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:41.176774 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:41.183941 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:41.184382 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:41.185174 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:41.185600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:41.669485 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:41.678593 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:41.680243 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:41.681778 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-feaa2d5a-54f3-478f-ab93-337d67219a9c tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.509815 Jul 12 07:18:41.682336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 353/692] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:41 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:41.846913 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:41.847462 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:41.853969 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:41.854406 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:41.855153 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:41.855576 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:41.867220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-58abadcd-2f8f-4648-9344-408712bb324c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:41.867823 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-58abadcd-2f8f-4648-9344-408712bb324c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:41.870926 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca HTTP/1.1 Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:18:41.872432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:18:41.873748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'f428539a-0743-4d98-889b-0c2e7f7ae5ca'} Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:18:41.874489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:18:41.875678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:18:41.876805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:18:41.876805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-22ca0459-ad85-44e4-9b09-0e9fa68c7263 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 404 len: 111 microversion: 2.1 time: 0.031011 Jul 12 07:18:41.876805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 340/693] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:41 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 07:18:41.876997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58abadcd-2f8f-4648-9344-408712bb324c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:41.876997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58abadcd-2f8f-4648-9344-408712bb324c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:41.876997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58abadcd-2f8f-4648-9344-408712bb324c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:41.876997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58abadcd-2f8f-4648-9344-408712bb324c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:41.886439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-71f3d655-30a8-4b4b-a826-ffc4ade27ca5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '.version_select at 0x7f70116d6280>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:41.892330 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:41.905825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-71f3d655-30a8-4b4b-a826-ffc4ade27ca5 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-701027465" status: 202 len: 0 microversion: 2.1 time: 0.023119 Jul 12 07:18:41.906514 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 341/694] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 12 07:18:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-701027465 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 07:18:42.096123 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-83979e87-ec8c-4d37-a148-74719b0255e7 req-dc90ae5e-f56d-44aa-b58a-09672296c492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f428539a-0743-4d98-889b-0c2e7f7ae5ca", "name": "network-vif-deleted", "tag": "017ad56e-17b2-4a1c-bbcb-b39197208153"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:42.114777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-83979e87-ec8c-4d37-a148-74719b0255e7 req-dc90ae5e-f56d-44aa-b58a-09672296c492 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:42.116246 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-83979e87-ec8c-4d37-a148-74719b0255e7 req-dc90ae5e-f56d-44aa-b58a-09672296c492 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:42.136005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-83979e87-ec8c-4d37-a148-74719b0255e7 req-dc90ae5e-f56d-44aa-b58a-09672296c492 service nova] Creating event network-vif-deleted:017ad56e-17b2-4a1c-bbcb-b39197208153 for instance f428539a-0743-4d98-889b-0c2e7f7ae5ca on hv-cinder-82549 Jul 12 07:18:42.143850 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-83979e87-ec8c-4d37-a148-74719b0255e7 req-dc90ae5e-f56d-44aa-b58a-09672296c492 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054210 Jul 12 07:18:42.145182 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 342/695] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:18:42.173705 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58abadcd-2f8f-4648-9344-408712bb324c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:42.182385 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-58abadcd-2f8f-4648-9344-408712bb324c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.319015 Jul 12 07:18:42.183065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 354/696] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:41 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:42.549766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5f9444d6-118a-4857-86e3-4176183eb136 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: .version_select at 0x7f70116ab4c0>, body: {"keypair": {"name": "tempest-keypair-954010994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lxQLe4Z8SHE1/WdwTF7eOOikkzO4zgCyOWu060GsWay+p7IlE6HVuOsAVJATGbRK0Uuodj/soA8yV/XPzaolYIwrUTQplcGDUqT35iLtAryvQFwyfxcAcZA10E2YpMg=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:42.572281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-5f9444d6-118a-4857-86e3-4176183eb136 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for project b52e5f4c43a3469db851b4704f422448. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:18:42.577821 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-5f9444d6-118a-4857-86e3-4176183eb136 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for user ef6395fa14b54c43931ffeaab023d97c and project b52e5f4c43a3469db851b4704f422448. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:18:42.616360 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5f9444d6-118a-4857-86e3-4176183eb136 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070883 Jul 12 07:18:42.621725 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 343/697] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:18:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:42.700089 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:42.700715 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:42.708187 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:42.708639 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:42.709869 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:42.710310 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:42.769315 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-b96df9ea-52f1-4984-b3fa-f9e9a0ac4475 req-b29ee120-33d2-4bd7-a13c-2af253b432d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7ccb04-eb99-4561-9c24-4480c4e0422e", "name": "network-vif-plugged", "status": "completed", "tag": "696d296b-c149-42d6-896a-50d0d9cc8ad8"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:42.778088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-b96df9ea-52f1-4984-b3fa-f9e9a0ac4475 req-b29ee120-33d2-4bd7-a13c-2af253b432d2 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:42.778924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-b96df9ea-52f1-4984-b3fa-f9e9a0ac4475 req-b29ee120-33d2-4bd7-a13c-2af253b432d2 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:42.792284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-b96df9ea-52f1-4984-b3fa-f9e9a0ac4475 req-b29ee120-33d2-4bd7-a13c-2af253b432d2 service nova] Creating event network-vif-plugged:696d296b-c149-42d6-896a-50d0d9cc8ad8 for instance cf7ccb04-eb99-4561-9c24-4480c4e0422e on hv-cinder-82549 Jul 12 07:18:42.797366 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-b96df9ea-52f1-4984-b3fa-f9e9a0ac4475 req-b29ee120-33d2-4bd7-a13c-2af253b432d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032180 Jul 12 07:18:42.797899 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 344/698] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:18:43.015166 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:43.026202 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:43.027838 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:43.028986 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2610d78e-503e-47a9-b697-7535fe0a1c6f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.333001 Jul 12 07:18:43.029706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 355/699] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:42 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:43.201452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a00fa32b-0291-4814-b587-9ca53937265f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:43.202125 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a00fa32b-0291-4814-b587-9ca53937265f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:43.210911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a00fa32b-0291-4814-b587-9ca53937265f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:43.211580 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a00fa32b-0291-4814-b587-9ca53937265f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:43.212416 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a00fa32b-0291-4814-b587-9ca53937265f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:43.213041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a00fa32b-0291-4814-b587-9ca53937265f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:43.478788 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a00fa32b-0291-4814-b587-9ca53937265f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:43.488236 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a00fa32b-0291-4814-b587-9ca53937265f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1576 microversion: 2.1 time: 0.291208 Jul 12 07:18:43.489430 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 345/700] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:43 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:44.047945 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:44.048488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:44.055728 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:44.056240 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:44.057310 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:44.057802 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:44.249388 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-892130625", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d84884e5-7556-4a7f-b022-9bd7a9e42f24"}], "security_groups": [{"name": "tempest-securitygroup--1863600121"}], "key_name": "tempest-keypair-954010994", "user_data": "}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:44.261413 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:44.270102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:44.273136 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:44.274970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e7012657-d261-4e95-92d8-4e7c0babd71b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.231121 Jul 12 07:18:44.275720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 356/701] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:44 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:44.439569 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] validate_networks() for [('d84884e5-7556-4a7f-b022-9bd7a9e42f24', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:18:44.505302 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-53d57750-ac81-4360-833c-016b354942fe tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:44.505898 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-53d57750-ac81-4360-833c-016b354942fe tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:44.512258 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53d57750-ac81-4360-833c-016b354942fe tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:44.512699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53d57750-ac81-4360-833c-016b354942fe tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:44.513489 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53d57750-ac81-4360-833c-016b354942fe tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:44.513913 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53d57750-ac81-4360-833c-016b354942fe tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:44.825239 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-53d57750-ac81-4360-833c-016b354942fe tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:44.835328 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-53d57750-ac81-4360-833c-016b354942fe tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1563 microversion: 2.1 time: 0.333993 Jul 12 07:18:44.836320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 357/702] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:44 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1563 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:45.128190 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:18:45.128595 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:18:45.129122 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:18:45.129474 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:18:45.129871 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:18:45.145619 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:45.146322 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:45.147484 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:45.148026 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:45.172564 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for project b52e5f4c43a3469db851b4704f422448. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:18:45.177350 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Getting quotas for user ef6395fa14b54c43931ffeaab023d97c and project b52e5f4c43a3469db851b4704f422448. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:18:45.192080 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:18:45.194417 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:18:45.249143 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e202a090-699a-4b91-bb80-c0686b1a7228 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.004347 Jul 12 07:18:45.249946 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 346/703] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:18:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:18:45.260723 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8f504271-d5d3-4630-aa9f-7a314614bee4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:45.261864 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8f504271-d5d3-4630-aa9f-7a314614bee4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:45.295856 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:45.296424 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:45.311320 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:45.319478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:45.320779 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:45.329754 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:45.347834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8f504271-d5d3-4630-aa9f-7a314614bee4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:45.355959 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8f504271-d5d3-4630-aa9f-7a314614bee4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1240 microversion: 2.1 time: 0.098592 Jul 12 07:18:45.357509 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 358/704] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:45 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:45.515199 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:45.523733 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:45.525692 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:45.527085 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7b8201ec-c757-4064-b0d6-a64e5b18e0ec tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.236658 Jul 12 07:18:45.528189 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 347/705] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:45 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:18:46.374724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0e3f9713-a6ad-4c36-9a8a-e78e8303b2d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:46.375308 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0e3f9713-a6ad-4c36-9a8a-e78e8303b2d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:46.383101 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e3f9713-a6ad-4c36-9a8a-e78e8303b2d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:46.383973 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e3f9713-a6ad-4c36-9a8a-e78e8303b2d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:46.384898 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e3f9713-a6ad-4c36-9a8a-e78e8303b2d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:46.385451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e3f9713-a6ad-4c36-9a8a-e78e8303b2d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:46.479831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0e3f9713-a6ad-4c36-9a8a-e78e8303b2d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:46.490701 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0e3f9713-a6ad-4c36-9a8a-e78e8303b2d9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1300 microversion: 2.1 time: 0.120630 Jul 12 07:18:46.501306 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 359/706] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:46 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:46.546592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:46.547941 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:46.556491 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:46.557003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:46.557958 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:46.558598 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:46.575328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:46.737168 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:46.746030 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:46.747544 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:46.748706 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2bd940ed-27a4-46db-b4f1-7172c8b7bb96 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.206381 Jul 12 07:18:46.749594 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 348/707] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:46 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:47.185427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-26b9af3f-5fd3-4926-9f26-f59050b09fd0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:47.185845 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-26b9af3f-5fd3-4926-9f26-f59050b09fd0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:47.192947 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26b9af3f-5fd3-4926-9f26-f59050b09fd0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:47.193419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26b9af3f-5fd3-4926-9f26-f59050b09fd0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:47.194395 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26b9af3f-5fd3-4926-9f26-f59050b09fd0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:47.194820 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26b9af3f-5fd3-4926-9f26-f59050b09fd0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:47.220908 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-26b9af3f-5fd3-4926-9f26-f59050b09fd0 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/ips" status: 200 len: 147 microversion: 2.1 time: 0.316379 Jul 12 07:18:47.221892 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 360/708] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:18:46 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/ips => generated 147 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:47.510141 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e241eec9-0043-4878-abf2-f0640d9656c8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:47.510764 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e241eec9-0043-4878-abf2-f0640d9656c8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:47.526341 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e241eec9-0043-4878-abf2-f0640d9656c8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:47.528166 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e241eec9-0043-4878-abf2-f0640d9656c8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:47.528999 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e241eec9-0043-4878-abf2-f0640d9656c8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:47.530999 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e241eec9-0043-4878-abf2-f0640d9656c8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:47.768857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:47.769660 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:47.776452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:47.777320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:47.778240 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:47.778666 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:47.787700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e241eec9-0043-4878-abf2-f0640d9656c8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:47.796097 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e241eec9-0043-4878-abf2-f0640d9656c8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1366 microversion: 2.1 time: 0.291731 Jul 12 07:18:47.797093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 349/709] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:47 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:48.003701 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:48.017454 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:48.020976 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:48.023046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd970756-7930-446f-aa5c-4340a5b393b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.259202 Jul 12 07:18:48.024053 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 361/710] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:47 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:18:48.234189 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-54b0f51d-d32d-4612-951c-7dfc7e4b7288 req-f60048e3-14a3-429d-bd58-b7d927b4aa5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b134f1-4e3a-442b-a5e0-010fcd684bf3", "tag": "47d43779-dabb-41eb-b293-4fa84b815c86"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:48.242814 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-54b0f51d-d32d-4612-951c-7dfc7e4b7288 req-f60048e3-14a3-429d-bd58-b7d927b4aa5e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:48.243331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-54b0f51d-d32d-4612-951c-7dfc7e4b7288 req-f60048e3-14a3-429d-bd58-b7d927b4aa5e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:48.262304 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-54b0f51d-d32d-4612-951c-7dfc7e4b7288 req-f60048e3-14a3-429d-bd58-b7d927b4aa5e service nova] Creating event network-changed:47d43779-dabb-41eb-b293-4fa84b815c86 for instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 on hv-cinder-82549 Jul 12 07:18:48.267579 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-54b0f51d-d32d-4612-951c-7dfc7e4b7288 req-f60048e3-14a3-429d-bd58-b7d927b4aa5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037142 Jul 12 07:18:48.268116 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 350/711] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:48.612806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-79f85437-eb5a-43c1-83fa-50ac5b16c5ca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abd209ed-47c6-42c0-852e-803ac0e1e601"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:48.614053 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-79f85437-eb5a-43c1-83fa-50ac5b16c5ca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:48.620238 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79f85437-eb5a-43c1-83fa-50ac5b16c5ca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:48.620681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79f85437-eb5a-43c1-83fa-50ac5b16c5ca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:48.621457 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79f85437-eb5a-43c1-83fa-50ac5b16c5ca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:48.621889 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79f85437-eb5a-43c1-83fa-50ac5b16c5ca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:48.817114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7bc638b7-9cda-42bb-8649-c9b0b22c1c52 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:48.817727 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7bc638b7-9cda-42bb-8649-c9b0b22c1c52 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:48.824261 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7bc638b7-9cda-42bb-8649-c9b0b22c1c52 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:48.824705 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7bc638b7-9cda-42bb-8649-c9b0b22c1c52 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:48.825510 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7bc638b7-9cda-42bb-8649-c9b0b22c1c52 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:48.825943 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7bc638b7-9cda-42bb-8649-c9b0b22c1c52 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:48.968513 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7bc638b7-9cda-42bb-8649-c9b0b22c1c52 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:48.976280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7bc638b7-9cda-42bb-8649-c9b0b22c1c52 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1366 microversion: 2.1 time: 0.165623 Jul 12 07:18:48.976877 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 351/712] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:48 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:49.042254 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:49.042862 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:49.049107 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:49.049611 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:49.050376 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:49.050811 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:49.180897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:49.189284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:49.191035 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:49.192272 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d3a7b88b-ab22-40a4-ac2e-67c6825b4536 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.153877 Jul 12 07:18:49.192742 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 352/713] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:49 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:18:49.824220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-79f85437-eb5a-43c1-83fa-50ac5b16c5ca tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.215532 Jul 12 07:18:49.825605 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 362/714] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:18:48 2022] POST /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments => generated 194 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:49.998327 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3b675d89-158f-4243-9690-270bcb9db98d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:49.998907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3b675d89-158f-4243-9690-270bcb9db98d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:50.006017 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b675d89-158f-4243-9690-270bcb9db98d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:50.006461 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b675d89-158f-4243-9690-270bcb9db98d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:50.007230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b675d89-158f-4243-9690-270bcb9db98d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:50.007844 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3b675d89-158f-4243-9690-270bcb9db98d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:50.206017 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3b675d89-158f-4243-9690-270bcb9db98d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:50.212263 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:50.213553 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:50.213884 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3b675d89-158f-4243-9690-270bcb9db98d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1366 microversion: 2.1 time: 0.221833 Jul 12 07:18:50.214654 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 353/715] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:49 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:50.220020 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:50.220461 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:50.221307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:50.221755 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:50.367386 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:50.377222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:50.379160 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:50.380519 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-69cef989-4b52-4ffe-a880-b891a7112932 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.173548 Jul 12 07:18:50.381099 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 363/716] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:50 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:51.235020 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9a23822f-d9e7-4f77-8693-4f2f60355b04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:51.236010 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9a23822f-d9e7-4f77-8693-4f2f60355b04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:51.248490 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a23822f-d9e7-4f77-8693-4f2f60355b04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:51.249268 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a23822f-d9e7-4f77-8693-4f2f60355b04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:51.250516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a23822f-d9e7-4f77-8693-4f2f60355b04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:51.251225 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9a23822f-d9e7-4f77-8693-4f2f60355b04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:51.397850 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9a23822f-d9e7-4f77-8693-4f2f60355b04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:51.399909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:51.400524 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:51.403066 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:51.408535 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9a23822f-d9e7-4f77-8693-4f2f60355b04 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1366 microversion: 2.1 time: 0.179583 Jul 12 07:18:51.408743 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:51.409187 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 354/717] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:51 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:51.409365 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:51.410194 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:51.410704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:51.545216 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:51.553790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:51.555262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:51.556399 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ba47cc24-d269-4e35-8bbf-29c1fa32f8a8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.160681 Jul 12 07:18:51.556966 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 364/718] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:51 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:52.429027 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b7a392cf-4a17-4abe-b312-163360e099ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:52.429609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b7a392cf-4a17-4abe-b312-163360e099ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:52.436654 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7a392cf-4a17-4abe-b312-163360e099ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:52.437093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7a392cf-4a17-4abe-b312-163360e099ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:52.437856 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7a392cf-4a17-4abe-b312-163360e099ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:52.438280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7a392cf-4a17-4abe-b312-163360e099ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:52.574299 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b7a392cf-4a17-4abe-b312-163360e099ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:52.574774 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:52.575378 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:52.582019 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:52.582199 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b7a392cf-4a17-4abe-b312-163360e099ef tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1366 microversion: 2.1 time: 0.158218 Jul 12 07:18:52.582606 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 355/719] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:52 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:52.582801 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:52.583688 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:52.584121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:52.723576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:52.731742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:52.733264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:52.734409 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f75cffef-39bb-42f3-aeba-227c28a6d35b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.163711 Jul 12 07:18:52.734974 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 365/720] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:52 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:53.603219 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d0672069-2578-4cb0-b2ed-d26a43d8c124 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:53.603823 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d0672069-2578-4cb0-b2ed-d26a43d8c124 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:53.614160 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d0672069-2578-4cb0-b2ed-d26a43d8c124 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:53.614597 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d0672069-2578-4cb0-b2ed-d26a43d8c124 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:53.615387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d0672069-2578-4cb0-b2ed-d26a43d8c124 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:53.615857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d0672069-2578-4cb0-b2ed-d26a43d8c124 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:53.752651 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:53.753298 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:53.758189 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d0672069-2578-4cb0-b2ed-d26a43d8c124 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:53.762255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:53.762698 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:53.763461 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:53.763896 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:53.766331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d0672069-2578-4cb0-b2ed-d26a43d8c124 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1366 microversion: 2.1 time: 0.169813 Jul 12 07:18:53.767163 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 356/721] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:53 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:53.920450 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:53.929627 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:53.931422 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:53.932991 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-df4dbbde-54f5-4f33-bc21-5bef251cb315 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.184374 Jul 12 07:18:53.933920 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 366/722] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:53 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:54.788031 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b1443e80-ca05-4c54-a938-69ce169872be tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:54.788792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b1443e80-ca05-4c54-a938-69ce169872be tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:54.795781 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1443e80-ca05-4c54-a938-69ce169872be tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:54.796220 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1443e80-ca05-4c54-a938-69ce169872be tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:54.796984 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1443e80-ca05-4c54-a938-69ce169872be tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:54.797447 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b1443e80-ca05-4c54-a938-69ce169872be tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:54.930824 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b1443e80-ca05-4c54-a938-69ce169872be tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:54.938878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b1443e80-ca05-4c54-a938-69ce169872be tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1366 microversion: 2.1 time: 0.157853 Jul 12 07:18:54.939457 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 357/723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:54 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:54.952894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:54.953627 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:54.960670 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:54.961153 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:54.961922 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:54.962349 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:55.091592 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:55.100029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:55.102436 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:55.103777 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-079c606a-c4c2-4df8-9808-63f2cd7bf979 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1747 microversion: 2.20 time: 0.154800 Jul 12 07:18:55.116526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 367/724] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:54 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:55.164261 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:55.186133 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=10 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:55.229356 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-d35f79fd-defb-4935-b73b-733c100cc15d req-18658edf-02f5-4586-bb95-288afc21a846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b134f1-4e3a-442b-a5e0-010fcd684bf3", "name": "network-vif-plugged", "status": "completed", "tag": "47d43779-dabb-41eb-b293-4fa84b815c86"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:55.237351 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-d35f79fd-defb-4935-b73b-733c100cc15d req-18658edf-02f5-4586-bb95-288afc21a846 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:55.237780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-d35f79fd-defb-4935-b73b-733c100cc15d req-18658edf-02f5-4586-bb95-288afc21a846 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:55.248655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-d35f79fd-defb-4935-b73b-733c100cc15d req-18658edf-02f5-4586-bb95-288afc21a846 service nova] Creating event network-vif-plugged:47d43779-dabb-41eb-b293-4fa84b815c86 for instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 on hv-cinder-82549 Jul 12 07:18:55.253509 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-d35f79fd-defb-4935-b73b-733c100cc15d req-18658edf-02f5-4586-bb95-288afc21a846 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153368 Jul 12 07:18:55.254088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 358/725] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:18:55.959740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d3add8b-3367-4e02-b814-a87ba6d704fe tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:55.960512 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d3add8b-3367-4e02-b814-a87ba6d704fe tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:55.962606 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:55.969663 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d3add8b-3367-4e02-b814-a87ba6d704fe tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:55.970150 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d3add8b-3367-4e02-b814-a87ba6d704fe tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:55.970990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d3add8b-3367-4e02-b814-a87ba6d704fe tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:55.971467 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d3add8b-3367-4e02-b814-a87ba6d704fe tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:56.114551 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d3add8b-3367-4e02-b814-a87ba6d704fe tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:56.122303 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d3add8b-3367-4e02-b814-a87ba6d704fe tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1366 microversion: 2.1 time: 0.169408 Jul 12 07:18:56.122848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 368/726] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:55 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:56.126441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:56.127168 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:56.134157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:56.134599 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:56.135358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:56.135789 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:56.275742 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:56.284226 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:56.285769 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:56.286986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-00c7b3f3-1d2f-4f53-a0b1-8d28ed83cb1b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1747 microversion: 2.20 time: 0.165517 Jul 12 07:18:56.287608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 359/727] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:56 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:57.139336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41916503-ebee-46a8-82c6-9f93d41a46e2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:57.139953 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-41916503-ebee-46a8-82c6-9f93d41a46e2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:57.146689 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41916503-ebee-46a8-82c6-9f93d41a46e2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:57.147154 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41916503-ebee-46a8-82c6-9f93d41a46e2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:57.147912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41916503-ebee-46a8-82c6-9f93d41a46e2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:57.148346 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41916503-ebee-46a8-82c6-9f93d41a46e2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:57.282159 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41916503-ebee-46a8-82c6-9f93d41a46e2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:57.290171 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41916503-ebee-46a8-82c6-9f93d41a46e2 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1556 microversion: 2.1 time: 0.154893 Jul 12 07:18:57.290815 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 369/728] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:18:57 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:18:57.307018 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:57.307213 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d97e2d21-6575-4110-92af-fe32cc669ffc tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:57.307673 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d97e2d21-6575-4110-92af-fe32cc669ffc tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:57.307906 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:57.313942 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:57.314125 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d97e2d21-6575-4110-92af-fe32cc669ffc tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:57.314568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:57.314686 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d97e2d21-6575-4110-92af-fe32cc669ffc tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:57.315321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d97e2d21-6575-4110-92af-fe32cc669ffc tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:57.315425 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:57.315747 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:57.315849 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d97e2d21-6575-4110-92af-fe32cc669ffc tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:57.427074 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d97e2d21-6575-4110-92af-fe32cc669ffc tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123944 Jul 12 07:18:57.428487 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 360/729] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 07:18:57 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:57.487822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:57.496794 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:57.498466 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:57.499700 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b4007084-b2ed-4847-a789-36583202ce88 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.196792 Jul 12 07:18:57.500266 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 370/730] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:57 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:18:58.457546 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f4a7f223-d3ae-4038-9cca-e0aea0bfea20 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:58.458526 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f4a7f223-d3ae-4038-9cca-e0aea0bfea20 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:58.470075 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4a7f223-d3ae-4038-9cca-e0aea0bfea20 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:58.470563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4a7f223-d3ae-4038-9cca-e0aea0bfea20 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:58.471333 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4a7f223-d3ae-4038-9cca-e0aea0bfea20 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:58.471762 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4a7f223-d3ae-4038-9cca-e0aea0bfea20 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:58.518748 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:58.519432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f4a7f223-d3ae-4038-9cca-e0aea0bfea20 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065720 Jul 12 07:18:58.519641 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:58.520355 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 361/731] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:18:58 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:58.530289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f9fb89c4-8c0e-4a45-b4a8-dd739b559139 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:58.530504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:58.531212 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:58.531694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:58.532095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:58.533229 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f9fb89c4-8c0e-4a45-b4a8-dd739b559139 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:58.540067 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:58.541849 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9fb89c4-8c0e-4a45-b4a8-dd739b559139 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:58.542845 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9fb89c4-8c0e-4a45-b4a8-dd739b559139 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:58.544019 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9fb89c4-8c0e-4a45-b4a8-dd739b559139 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:58.546301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f9fb89c4-8c0e-4a45-b4a8-dd739b559139 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:58.581539 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f9fb89c4-8c0e-4a45-b4a8-dd739b559139 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/abd209ed-47c6-42c0-852e-803ac0e1e601" status: 200 len: 194 microversion: 2.1 time: 0.055003 Jul 12 07:18:58.582441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 362/732] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Jul 12 07:18:58 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/abd209ed-47c6-42c0-852e-803ac0e1e601 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:58.700546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:58.713317 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:58.715276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:18:58.716732 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-91bae9bd-5567-4e57-92ef-f0f3a46569b3 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.201938 Jul 12 07:18:58.717858 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 371/733] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:58 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:18:58.911103 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-5dedd1f7-193b-49b1-8277-9e77d8bdfac6 req-79a4c3c1-afab-41df-9adb-d197358560b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b134f1-4e3a-442b-a5e0-010fcd684bf3", "tag": "47d43779-dabb-41eb-b293-4fa84b815c86"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:58.932497 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5dedd1f7-193b-49b1-8277-9e77d8bdfac6 req-79a4c3c1-afab-41df-9adb-d197358560b1 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:58.934735 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5dedd1f7-193b-49b1-8277-9e77d8bdfac6 req-79a4c3c1-afab-41df-9adb-d197358560b1 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:58.976430 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-5dedd1f7-193b-49b1-8277-9e77d8bdfac6 req-79a4c3c1-afab-41df-9adb-d197358560b1 service nova] Creating event network-changed:47d43779-dabb-41eb-b293-4fa84b815c86 for instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 on hv-cinder-82549 Jul 12 07:18:58.986506 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-5dedd1f7-193b-49b1-8277-9e77d8bdfac6 req-79a4c3c1-afab-41df-9adb-d197358560b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176606 Jul 12 07:18:59.016873 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 363/734] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:59.526350 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-92086d35-e2c4-4cd2-9bbf-f0dd18bfe645 req-8de4e452-36e6-4422-b321-112516caf2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8a7f04-501d-4547-b7ca-9e19f7d59c32", "name": "network-vif-plugged", "status": "completed", "tag": "3564b5da-8b1e-491d-b0b1-502090eeb718"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:18:59.550690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-92086d35-e2c4-4cd2-9bbf-f0dd18bfe645 req-8de4e452-36e6-4422-b321-112516caf2b3 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:59.550690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-92086d35-e2c4-4cd2-9bbf-f0dd18bfe645 req-8de4e452-36e6-4422-b321-112516caf2b3 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:59.575505 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-92086d35-e2c4-4cd2-9bbf-f0dd18bfe645 req-8de4e452-36e6-4422-b321-112516caf2b3 service nova] Creating event network-vif-plugged:3564b5da-8b1e-491d-b0b1-502090eeb718 for instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 on hv-cinder-82549 Jul 12 07:18:59.602776 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-92086d35-e2c4-4cd2-9bbf-f0dd18bfe645 req-8de4e452-36e6-4422-b321-112516caf2b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082796 Jul 12 07:18:59.603385 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 372/735] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:18:59.739325 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:18:59.741149 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:18:59.760105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:59.762770 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:18:59.764231 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:18:59.765067 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:00.106142 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:00.118180 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:00.120309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:00.121711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-38c8eb12-3b2e-4a69-9326-8dc367dcbcdc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.389194 Jul 12 07:19:00.122269 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 364/736] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:18:59 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:00.264579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8256faa3-b771-4589-9b88-1c76059fd405 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86af2e4c-4523-4d5e-ae4b-c1e030bd97d0"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:19:00.266192 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8256faa3-b771-4589-9b88-1c76059fd405 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:00.277338 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8256faa3-b771-4589-9b88-1c76059fd405 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:00.278162 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8256faa3-b771-4589-9b88-1c76059fd405 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:00.280001 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8256faa3-b771-4589-9b88-1c76059fd405 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:00.280531 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8256faa3-b771-4589-9b88-1c76059fd405 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:00.666897 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8256faa3-b771-4589-9b88-1c76059fd405 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "POST /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407299 Jul 12 07:19:00.668082 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 373/737] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:19:00 2022] POST /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:01.140431 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:01.141027 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:01.143534 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:01.151358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:01.152096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:01.152921 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:01.153559 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:01.317386 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:01.327446 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:01.331854 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:01.333203 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-63014afe-44e6-4ccb-8df9-ad0dc98397f1 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.196742 Jul 12 07:19:01.336386 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 365/738] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:01 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:02.353818 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:02.355223 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:02.361109 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:02.361844 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:02.362824 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:02.363461 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:02.504610 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:02.517743 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:02.519588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:02.521017 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08239cad-e01a-48c4-9c23-00874d1f3c97 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.171997 Jul 12 07:19:02.521804 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 374/739] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:02 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:03.539690 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:03.540302 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:03.549176 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:03.549616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:03.550395 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:03.550830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:03.703748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:03.712636 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:03.715569 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:03.718290 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-87b2e6f2-6774-4436-b7be-ea2afa83cf40 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.182625 Jul 12 07:19:03.719077 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 366/740] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:03 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:04.737641 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:04.738908 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:04.745677 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:04.746116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:04.746889 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:04.747317 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:04.926208 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:04.934530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:04.936157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:04.937430 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eb08846d-e7b6-429c-a289-c30c3fcff52f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.203833 Jul 12 07:19:04.938392 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 375/741] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:04 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:05.956098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:05.956736 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:05.964148 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:05.964586 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:05.965369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:05.965792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:05.983727 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:06.139046 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:06.147446 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:06.148968 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:06.150162 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9dd4de53-3629-4263-975a-c975be7f8761 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.198057 Jul 12 07:19:06.152420 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 367/742] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:05 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:07.169389 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:07.169962 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:07.177081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:07.177649 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:07.178406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:07.178831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:07.326100 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:07.335955 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:07.337757 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:07.338998 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d86d406d-6613-4048-b37e-02b9ae7ac26d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.173618 Jul 12 07:19:07.339650 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 376/743] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:07 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:08.264288 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-573a17ce-3b1a-4a56-bf15-7dbcf8eec66a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:08.265329 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-573a17ce-3b1a-4a56-bf15-7dbcf8eec66a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:08.272460 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-573a17ce-3b1a-4a56-bf15-7dbcf8eec66a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:08.272902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-573a17ce-3b1a-4a56-bf15-7dbcf8eec66a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:08.273682 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-573a17ce-3b1a-4a56-bf15-7dbcf8eec66a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:08.274108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-573a17ce-3b1a-4a56-bf15-7dbcf8eec66a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:08.303580 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-573a17ce-3b1a-4a56-bf15-7dbcf8eec66a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043236 Jul 12 07:19:08.304192 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 368/744] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:19:08 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:08.363655 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:08.364634 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:08.375691 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:08.376367 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:08.377694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:08.378514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:08.451593 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dedb5cc4-d777-4bcf-a356-675a51f01655 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:08.452708 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dedb5cc4-d777-4bcf-a356-675a51f01655 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:08.459114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dedb5cc4-d777-4bcf-a356-675a51f01655 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:08.459555 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dedb5cc4-d777-4bcf-a356-675a51f01655 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:08.460557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dedb5cc4-d777-4bcf-a356-675a51f01655 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:08.461632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dedb5cc4-d777-4bcf-a356-675a51f01655 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:08.490299 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dedb5cc4-d777-4bcf-a356-675a51f01655 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/abd209ed-47c6-42c0-852e-803ac0e1e601" status: 200 len: 194 microversion: 2.1 time: 0.042610 Jul 12 07:19:08.490898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 369/745] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Jul 12 07:19:08 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/abd209ed-47c6-42c0-852e-803ac0e1e601 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:08.500308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-50d60a81-d2b1-48d4-810a-c247ed3afd17 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:08.500787 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-50d60a81-d2b1-48d4-810a-c247ed3afd17 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:08.507602 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50d60a81-d2b1-48d4-810a-c247ed3afd17 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:08.508273 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50d60a81-d2b1-48d4-810a-c247ed3afd17 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:08.509032 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50d60a81-d2b1-48d4-810a-c247ed3afd17 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:08.509496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-50d60a81-d2b1-48d4-810a-c247ed3afd17 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:08.512430 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:08.520440 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:08.521950 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:08.523217 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5254ae11-e9d8-4473-a60e-41fd5c9abf8d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1742 microversion: 2.20 time: 0.166116 Jul 12 07:19:08.523787 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 377/746] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:08 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:08.591006 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-50d60a81-d2b1-48d4-810a-c247ed3afd17 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lazy-loading 'services' on Instance uuid 9fe4fd46-2e3e-473e-952d-7bae1741f74b {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:19:08.666950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-50d60a81-d2b1-48d4-810a-c247ed3afd17 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/abd209ed-47c6-42c0-852e-803ac0e1e601" status: 202 len: 0 microversion: 2.1 time: 0.170097 Jul 12 07:19:08.667545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 370/747] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:19:08 2022] DELETE /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/abd209ed-47c6-42c0-852e-803ac0e1e601 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 07:19:09.546172 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:09.547161 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:09.556291 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:09.556741 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:09.557608 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:09.558062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:09.707372 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:09.720278 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:09.722224 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:09.723637 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8095528f-f346-4c3e-8e6b-4277fba099e0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1724 microversion: 2.20 time: 0.183879 Jul 12 07:19:09.723905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 378/748] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:09 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:10.748127 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:10.749309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:10.759055 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:10.759495 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:10.760258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:10.760681 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:10.898981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:10.907300 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:10.908807 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:10.909981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c98f8d7a-1b8d-4859-8d51-03676ca53a3a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1724 microversion: 2.20 time: 0.170087 Jul 12 07:19:10.910523 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 371/749] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:10 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:11.928490 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:11.929064 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:11.936190 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:11.936630 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:11.937382 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:11.937808 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:12.106527 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:12.119349 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:12.121176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:12.122630 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ef51cf5e-5861-449b-9ca4-a568230a17de tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1724 microversion: 2.20 time: 0.197883 Jul 12 07:19:12.123454 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 379/750] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:11 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:13.149617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:13.150337 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:13.157702 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:13.158141 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:13.158893 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:13.159310 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:13.300589 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:13.308947 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:13.310440 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:13.311571 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8c17970b-467e-470b-a688-3c5fbd32f8f7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1724 microversion: 2.20 time: 0.168653 Jul 12 07:19:13.312137 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 372/751] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:13 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:14.277352 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-447f82f0-dd30-4f06-b19d-051b600393a4 req-6a4564e7-a313-42c2-8bac-00c928e85af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8a7f04-501d-4547-b7ca-9e19f7d59c32", "name": "network-vif-unplugged", "status": "completed", "tag": "3564b5da-8b1e-491d-b0b1-502090eeb718"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:19:14.286360 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-447f82f0-dd30-4f06-b19d-051b600393a4 req-6a4564e7-a313-42c2-8bac-00c928e85af6 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:14.286776 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-447f82f0-dd30-4f06-b19d-051b600393a4 req-6a4564e7-a313-42c2-8bac-00c928e85af6 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:14.298070 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-447f82f0-dd30-4f06-b19d-051b600393a4 req-6a4564e7-a313-42c2-8bac-00c928e85af6 service nova] Creating event network-vif-unplugged:3564b5da-8b1e-491d-b0b1-502090eeb718 for instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 on hv-cinder-82549 Jul 12 07:19:14.302912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-447f82f0-dd30-4f06-b19d-051b600393a4 req-6a4564e7-a313-42c2-8bac-00c928e85af6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029392 Jul 12 07:19:14.303499 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 380/752] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:14.329382 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:14.329981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:14.336629 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:14.337145 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:14.337911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:14.338338 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:14.472168 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:14.484907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:14.487299 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:14.489286 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bb3fd3e5-a0f5-4385-9057-a8f2009da471 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1724 microversion: 2.20 time: 0.163591 Jul 12 07:19:14.490156 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 373/753] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:14 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:15.509484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:15.510065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:15.516960 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:15.517451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:15.518147 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:15.518901 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:15.660480 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:15.669374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:15.670874 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:15.672030 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e4b74acb-b035-42ac-8252-a05776eb8a8b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1724 microversion: 2.20 time: 0.167647 Jul 12 07:19:15.672566 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 381/754] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:15 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:19:16.168495 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4b70d5d9-6234-4acc-b8e9-52b5ce61cf69 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:16.168997 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4b70d5d9-6234-4acc-b8e9-52b5ce61cf69 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:16.175840 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4b70d5d9-6234-4acc-b8e9-52b5ce61cf69 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:16.176291 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4b70d5d9-6234-4acc-b8e9-52b5ce61cf69 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:16.177101 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4b70d5d9-6234-4acc-b8e9-52b5ce61cf69 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:16.177719 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4b70d5d9-6234-4acc-b8e9-52b5ce61cf69 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:16.207009 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4b70d5d9-6234-4acc-b8e9-52b5ce61cf69 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/86af2e4c-4523-4d5e-ae4b-c1e030bd97d0" status: 200 len: 194 microversion: 2.1 time: 0.042799 Jul 12 07:19:16.207585 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 374/755] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Jul 12 07:19:16 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/86af2e4c-4523-4d5e-ae4b-c1e030bd97d0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:16.219333 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6c985cc2-15e8-4693-be75-79ecf247962d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:16.220074 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6c985cc2-15e8-4693-be75-79ecf247962d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:16.230253 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c985cc2-15e8-4693-be75-79ecf247962d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:16.231046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c985cc2-15e8-4693-be75-79ecf247962d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:16.231972 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c985cc2-15e8-4693-be75-79ecf247962d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:16.232414 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c985cc2-15e8-4693-be75-79ecf247962d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:16.333809 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-6c985cc2-15e8-4693-be75-79ecf247962d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lazy-loading 'services' on Instance uuid 9fe4fd46-2e3e-473e-952d-7bae1741f74b {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:19:16.408038 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6c985cc2-15e8-4693-be75-79ecf247962d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/86af2e4c-4523-4d5e-ae4b-c1e030bd97d0" status: 202 len: 0 microversion: 2.1 time: 0.194156 Jul 12 07:19:16.408644 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 382/756] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:19:16 2022] DELETE /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments/86af2e4c-4523-4d5e-ae4b-c1e030bd97d0 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:19:16.693112 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:16.693965 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:16.704186 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:16.704847 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:16.705907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:16.706408 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:16.854389 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:16.862452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:16.863939 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:16.865109 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6bce2587-44d6-4647-b893-99460abcbebb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1724 microversion: 2.20 time: 0.178136 Jul 12 07:19:16.865721 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 375/757] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:16 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:17.884690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:17.885466 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:17.892112 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:17.892544 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:17.893310 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:17.893737 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.030658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:18.039036 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:18.040544 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:18.041711 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9826ba61-f73b-46a8-aa6a-2d6dadcf705b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1727 microversion: 2.20 time: 0.161936 Jul 12 07:19:18.042268 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 383/758] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:17 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:18.059546 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1259d456-33e2-4fa9-aad1-4463fe60a36f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e21cca6-9267-4043-8997-6c7b41e13dbf"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:19:18.060596 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1259d456-33e2-4fa9-aad1-4463fe60a36f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:18.066897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1259d456-33e2-4fa9-aad1-4463fe60a36f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.067365 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1259d456-33e2-4fa9-aad1-4463fe60a36f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.068076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1259d456-33e2-4fa9-aad1-4463fe60a36f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.068499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1259d456-33e2-4fa9-aad1-4463fe60a36f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.351889 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1259d456-33e2-4fa9-aad1-4463fe60a36f tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296251 Jul 12 07:19:18.352784 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 376/759] 10.222.0.25 () {62 vars in 1363 bytes} [Tue Jul 12 07:19:18 2022] POST /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 07:19:18.472973 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6926d384-e57f-4b1c-bea7-d3ee92d4928b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:18.473725 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6926d384-e57f-4b1c-bea7-d3ee92d4928b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:18.482312 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6926d384-e57f-4b1c-bea7-d3ee92d4928b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.482962 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6926d384-e57f-4b1c-bea7-d3ee92d4928b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.484506 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6926d384-e57f-4b1c-bea7-d3ee92d4928b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.484952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6926d384-e57f-4b1c-bea7-d3ee92d4928b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.650777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3bcd534a-c213-427a-9ea3-8388011f1d44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:18.651797 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3bcd534a-c213-427a-9ea3-8388011f1d44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:18.658556 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3bcd534a-c213-427a-9ea3-8388011f1d44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.659000 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3bcd534a-c213-427a-9ea3-8388011f1d44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.659763 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3bcd534a-c213-427a-9ea3-8388011f1d44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.660196 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3bcd534a-c213-427a-9ea3-8388011f1d44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.689650 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3bcd534a-c213-427a-9ea3-8388011f1d44 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043115 Jul 12 07:19:18.690568 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 377/760] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:19:18 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:19:18.756581 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:18.766577 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6926d384-e57f-4b1c-bea7-d3ee92d4928b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "DELETE /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/os-volume_attachments/5e21cca6-9267-4043-8997-6c7b41e13dbf" status: 202 len: 0 microversion: 2.20 time: 0.299679 Jul 12 07:19:18.767236 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 384/761] 10.222.0.25 () {60 vars in 1456 bytes} [Tue Jul 12 07:19:18 2022] DELETE /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/os-volume_attachments/5e21cca6-9267-4043-8997-6c7b41e13dbf => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:19:18.805003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0eff8a0b-732c-43b1-ad5b-919efefe7b87 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:18.805952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0eff8a0b-732c-43b1-ad5b-919efefe7b87 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:18.812208 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0eff8a0b-732c-43b1-ad5b-919efefe7b87 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.812656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0eff8a0b-732c-43b1-ad5b-919efefe7b87 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.813497 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0eff8a0b-732c-43b1-ad5b-919efefe7b87 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.813970 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0eff8a0b-732c-43b1-ad5b-919efefe7b87 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.826541 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dcb6a996-e06c-412e-a175-0cbf882b4dcc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:19:18.827102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dcb6a996-e06c-412e-a175-0cbf882b4dcc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:18.834427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcb6a996-e06c-412e-a175-0cbf882b4dcc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.834865 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcb6a996-e06c-412e-a175-0cbf882b4dcc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.835627 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcb6a996-e06c-412e-a175-0cbf882b4dcc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.836058 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcb6a996-e06c-412e-a175-0cbf882b4dcc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.844220 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0eff8a0b-732c-43b1-ad5b-919efefe7b87 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043185 Jul 12 07:19:18.844800 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 378/762] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:19:18 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:19:18.902065 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2ccdf3af-8c75-4fa5-8530-35e52f909bfb tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:18.902609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2ccdf3af-8c75-4fa5-8530-35e52f909bfb tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:18.909324 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2ccdf3af-8c75-4fa5-8530-35e52f909bfb tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.909767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2ccdf3af-8c75-4fa5-8530-35e52f909bfb tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.910527 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2ccdf3af-8c75-4fa5-8530-35e52f909bfb tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:18.910956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2ccdf3af-8c75-4fa5-8530-35e52f909bfb tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:18.935562 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2ccdf3af-8c75-4fa5-8530-35e52f909bfb tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:19:18.969482 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:19.020499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2ccdf3af-8c75-4fa5-8530-35e52f909bfb tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 204 len: 0 microversion: 2.1 time: 0.122160 Jul 12 07:19:19.021497 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 379/763] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:19:18 2022] DELETE /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 07:19:19.029930 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d6ef2c7e-534b-4216-b9f0-a73cfeb72346 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:19.030620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d6ef2c7e-534b-4216-b9f0-a73cfeb72346 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:19.037605 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6ef2c7e-534b-4216-b9f0-a73cfeb72346 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:19.038052 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6ef2c7e-534b-4216-b9f0-a73cfeb72346 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:19.040465 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6ef2c7e-534b-4216-b9f0-a73cfeb72346 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:19.040465 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6ef2c7e-534b-4216-b9f0-a73cfeb72346 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:19.045087 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dcb6a996-e06c-412e-a175-0cbf882b4dcc tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "POST /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/action" status: 202 len: 0 microversion: 2.20 time: 0.222540 Jul 12 07:19:19.046214 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 385/764] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 12 07:19:18 2022] POST /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:19:19.054297 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:19.055092 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:19.062709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:19.063368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:19.064419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:19.065159 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:19.316464 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d6ef2c7e-534b-4216-b9f0-a73cfeb72346 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:19.330776 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d6ef2c7e-534b-4216-b9f0-a73cfeb72346 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1675 microversion: 2.1 time: 0.304735 Jul 12 07:19:19.331675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 380/765] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:19 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1675 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:19:19.356272 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:19.368804 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:19.370408 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:19.372920 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1ca748de-9e74-42db-b886-82d521a03fd6 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1675 microversion: 2.20 time: 0.322049 Jul 12 07:19:19.377565 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 386/766] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:19 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1675 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:20.355471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d6465a09-31ec-411c-8c3b-8114373d63e4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:20.356542 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d6465a09-31ec-411c-8c3b-8114373d63e4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:20.362986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6465a09-31ec-411c-8c3b-8114373d63e4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:20.363422 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6465a09-31ec-411c-8c3b-8114373d63e4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:20.364175 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6465a09-31ec-411c-8c3b-8114373d63e4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:20.364605 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d6465a09-31ec-411c-8c3b-8114373d63e4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:20.391860 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:20.392458 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:20.399457 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:20.399904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:20.400787 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:20.401229 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:20.553631 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d6465a09-31ec-411c-8c3b-8114373d63e4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:20.562159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d6465a09-31ec-411c-8c3b-8114373d63e4 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1675 microversion: 2.1 time: 0.210962 Jul 12 07:19:20.562915 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 381/767] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:20 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1675 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:19:20.586353 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:20.594555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:20.596029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:20.597195 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6b069566-1da2-4e93-9595-ac11498b69b8 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1675 microversion: 2.20 time: 0.209276 Jul 12 07:19:20.597753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 387/768] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:20 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1675 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:21.581204 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1802354a-a569-40dd-8a87-1f1b920c33b9 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:21.581978 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1802354a-a569-40dd-8a87-1f1b920c33b9 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:21.588801 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1802354a-a569-40dd-8a87-1f1b920c33b9 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:21.589336 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1802354a-a569-40dd-8a87-1f1b920c33b9 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:21.590162 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1802354a-a569-40dd-8a87-1f1b920c33b9 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:21.590851 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1802354a-a569-40dd-8a87-1f1b920c33b9 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:21.615202 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:21.615900 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:21.622826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=50 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:21.624623 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:21.625148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:21.625997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:21.626433 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:21.955388 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1802354a-a569-40dd-8a87-1f1b920c33b9 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:21.966346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1802354a-a569-40dd-8a87-1f1b920c33b9 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1675 microversion: 2.1 time: 0.388877 Jul 12 07:19:21.978133 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 382/769] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:21 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1675 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:19:21.983236 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:22.006873 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:22.008956 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:22.011322 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2085ab37-8366-4814-8ddd-b2095eb2c84e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.400063 Jul 12 07:19:22.012447 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 388/770] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:21 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:22.756625 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-8ab597dc-ed9f-45df-9cb3-61bd953362b6 req-74e3b871-651b-4064-ad1c-3b4f1eb4f777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe4fd46-2e3e-473e-952d-7bae1741f74b", "name": "network-vif-deleted", "tag": "aa44cae3-47b4-4937-8462-55d04fdc53d0"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:19:22.765801 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8ab597dc-ed9f-45df-9cb3-61bd953362b6 req-74e3b871-651b-4064-ad1c-3b4f1eb4f777 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:22.766237 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8ab597dc-ed9f-45df-9cb3-61bd953362b6 req-74e3b871-651b-4064-ad1c-3b4f1eb4f777 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:22.777773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-8ab597dc-ed9f-45df-9cb3-61bd953362b6 req-74e3b871-651b-4064-ad1c-3b4f1eb4f777 service nova] Creating event network-vif-deleted:aa44cae3-47b4-4937-8462-55d04fdc53d0 for instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b on hv-cinder-82549 Jul 12 07:19:22.783039 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-8ab597dc-ed9f-45df-9cb3-61bd953362b6 req-74e3b871-651b-4064-ad1c-3b4f1eb4f777 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030053 Jul 12 07:19:22.783628 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 383/771] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:22.985793 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0a8a85b5-bc1c-40f8-90df-b3472c95508a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:22.986360 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0a8a85b5-bc1c-40f8-90df-b3472c95508a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:22.993237 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a8a85b5-bc1c-40f8-90df-b3472c95508a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:22.993680 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a8a85b5-bc1c-40f8-90df-b3472c95508a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:22.994424 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a8a85b5-bc1c-40f8-90df-b3472c95508a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:22.994832 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a8a85b5-bc1c-40f8-90df-b3472c95508a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:23.032375 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:23.033231 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:23.039748 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:23.040406 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:23.041203 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:23.041627 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:23.066744 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0a8a85b5-bc1c-40f8-90df-b3472c95508a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:23.074576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0a8a85b5-bc1c-40f8-90df-b3472c95508a tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1608 microversion: 2.1 time: 0.093171 Jul 12 07:19:23.075426 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 389/772] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:22 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1608 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:19:23.175298 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:23.183196 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:23.184814 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:23.186310 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-320a5c9b-fa74-4bf1-a114-b837252d5a5e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.158778 Jul 12 07:19:23.186839 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 384/773] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:23 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:19:24.092970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fca62c52-6ae1-41e0-9e2b-1c771c47be96 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:24.093669 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fca62c52-6ae1-41e0-9e2b-1c771c47be96 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:24.100948 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fca62c52-6ae1-41e0-9e2b-1c771c47be96 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:24.101425 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fca62c52-6ae1-41e0-9e2b-1c771c47be96 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:24.102190 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fca62c52-6ae1-41e0-9e2b-1c771c47be96 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:24.102718 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fca62c52-6ae1-41e0-9e2b-1c771c47be96 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:24.175283 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fca62c52-6ae1-41e0-9e2b-1c771c47be96 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:24.184029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fca62c52-6ae1-41e0-9e2b-1c771c47be96 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1608 microversion: 2.1 time: 0.095408 Jul 12 07:19:24.184614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 390/774] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:24 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1608 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:19:24.204639 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:24.205316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:24.213685 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:24.214132 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:24.214892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:24.215328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:24.369650 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:24.378963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:24.380459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:24.381645 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f5a836df-527d-4e1b-80d2-4eb061d1154a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.181351 Jul 12 07:19:24.382241 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 385/775] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:24 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:25.201986 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:25.202626 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:25.209435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:25.209870 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:25.210615 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:25.211040 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:25.241397 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:25.241838 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:25.242268 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lazy-loading 'fault' on Instance uuid 9fe4fd46-2e3e-473e-952d-7bae1741f74b {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:19:25.285813 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583143af14a645238262214515ee148f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be635735d174893be20f99110cacbfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:25.293462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-147c7606-dd5e-4b99-9520-158502e1cc1d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 200 len: 1328 microversion: 2.1 time: 0.095303 Jul 12 07:19:25.294022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 391/776] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:25 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:19:25.410897 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:25.411955 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:25.423200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:25.423632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:25.424394 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:25.424823 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:25.564499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:25.572878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:25.574491 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:25.575539 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9ad71e8d-b7d5-459c-95a0-6b25b513424b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.172173 Jul 12 07:19:25.576484 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 386/777] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:25 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:26.318415 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:26.319028 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:26.330648 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:26.331172 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:26.332310 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:26.332811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:26.347836 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] HTTP exception thrown: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Request method failure captured: Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b HTTP/1.1 Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8KYjPkdJ43t88kh-kC7MeiVe2L7S7xD28zModJqTETNXQzVeciG8G6d95pLBwCJG2EpfLLrqW0rBC9Q0_NfWZB_v4CmQq0vVZRlmEq3l75cmkr0jM8dcdbf4e_QJQ0AmxJf2DTY561h75jhdbu9UtbGrBKxvSbTRYJ-1ET2tGTQ3Y Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:19:26.349695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6be635735d174893be20f99110cacbfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6be635735d174893be20f99110cacbfa"}]}] Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 583143af14a645238262214515ee148f Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:26.351316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '9fe4fd46-2e3e-473e-952d-7bae1741f74b'} Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:19:26.352257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:26.353933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:26.355064 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Returning 404 to user: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:19:26.355064 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-35f6ceeb-5fe4-48f6-a1af-0f283aa03e4d tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 404 len: 111 microversion: 2.1 time: 0.037152 Jul 12 07:19:26.355064 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 392/778] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:26 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:19:26.361346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-64c11373-38dd-46da-87cb-6d447d23f3da tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '.version_select at 0x7f70116638b0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:26.390496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-64c11373-38dd-46da-87cb-6d447d23f3da tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285700976" status: 202 len: 0 microversion: 2.1 time: 0.033242 Jul 12 07:19:26.391838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 387/779] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 12 07:19:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285700976 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:19:26.594296 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:26.596016 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:26.611542 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:26.611991 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:26.614935 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:26.615373 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:26.900233 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:26.909538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:26.911034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:26.912192 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eca0683a-3e12-4bfd-b721-3788c858d367 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.321969 Jul 12 07:19:26.912752 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 393/780] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:26 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:27.932678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:27.933430 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:27.940408 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:27.940931 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:27.941721 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:27.942317 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:28.082158 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:28.090722 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:28.092329 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:28.093729 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-21c4a754-ce8e-4557-8523-8c0f2f19c1b2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.165550 Jul 12 07:19:28.094548 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 388/781] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:27 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:29.113272 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:29.114772 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:29.125553 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:29.126586 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:29.127740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:29.128545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:29.289421 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:29.302734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:29.304470 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:29.305861 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-929f5744-b40f-47ce-b05a-fd38252492be tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.196917 Jul 12 07:19:29.306907 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 394/782] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:29 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:29.525867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:29.526735 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:29.544472 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:29.544948 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:29.548381 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:29.548899 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:29.576048 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] HTTP exception thrown: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Request method failure captured: Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b HTTP/1.1 Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8KYjPkdJ43t88kh-kC7MeiVe2L7S7xD28zModJqTETNXQzVeciG8G6d95pLBwCJG2EpfLLrqW0rBC9Q0_NfWZB_v4CmQq0vVZRlmEq3l75cmkr0jM8dcdbf4e_QJQ0AmxJf2DTY561h75jhdbu9UtbGrBKxvSbTRYJ-1ET2tGTQ3Y Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:19:29.577771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6be635735d174893be20f99110cacbfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6be635735d174893be20f99110cacbfa"}]}] Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 583143af14a645238262214515ee148f Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.579283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '9fe4fd46-2e3e-473e-952d-7bae1741f74b'} Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:19:29.580054 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.582210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.584989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Returning 404 to user: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:19:29.584989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1585eee1-d25d-4a21-8e9e-1a2a746d8e1b tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 404 len: 111 microversion: 2.1 time: 0.058244 Jul 12 07:19:29.584989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 389/783] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:19:29 2022] DELETE /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:19:29.591076 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:29.591999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: 9fe4fd46-2e3e-473e-952d-7bae1741f74b] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:29.598694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:29.599142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:29.601372 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:29.602357 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:29.620115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] HTTP exception thrown: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Request method failure captured: Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b HTTP/1.1 Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8KYjPkdJ43t88kh-kC7MeiVe2L7S7xD28zModJqTETNXQzVeciG8G6d95pLBwCJG2EpfLLrqW0rBC9Q0_NfWZB_v4CmQq0vVZRlmEq3l75cmkr0jM8dcdbf4e_QJQ0AmxJf2DTY561h75jhdbu9UtbGrBKxvSbTRYJ-1ET2tGTQ3Y Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:19:29.621868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6be635735d174893be20f99110cacbfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6be635735d174893be20f99110cacbfa"}]}] Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 583143af14a645238262214515ee148f Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.623148 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '9fe4fd46-2e3e-473e-952d-7bae1741f74b'} Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:19:29.623882 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. Jul 12 07:19:29.625816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:29.628169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Returning 404 to user: Instance 9fe4fd46-2e3e-473e-952d-7bae1741f74b could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:19:29.628169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8e3125d7-c5cd-43e0-ad35-4d20c94eda83 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b" status: 404 len: 111 microversion: 2.1 time: 0.038334 Jul 12 07:19:29.628169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 395/784] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:29 2022] GET /compute/v2.1/servers/9fe4fd46-2e3e-473e-952d-7bae1741f74b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:19:30.327002 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:30.328621 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:30.335784 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:30.336550 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:30.337666 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:30.338428 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:30.488128 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:30.496682 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:30.498925 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:30.500376 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3a51b8e7-8301-4e9e-8fca-28f240670dd2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.177865 Jul 12 07:19:30.501945 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 390/785] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:30 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:30.813563 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:30.814050 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:30.822431 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:30.823002 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:30.823836 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:30.824337 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:30.842061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] HTTP exception thrown: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Request method failure captured: Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: DELETE /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 HTTP/1.1 Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8KYjPkdJ43t88kh-kC7MeiVe2L7S7xD28zModJqTETNXQzVeciG8G6d95pLBwCJG2EpfLLrqW0rBC9Q0_NfWZB_v4CmQq0vVZRlmEq3l75cmkr0jM8dcdbf4e_QJQ0AmxJf2DTY561h75jhdbu9UtbGrBKxvSbTRYJ-1ET2tGTQ3Y Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:19:30.844079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6be635735d174893be20f99110cacbfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6be635735d174893be20f99110cacbfa"}]}] Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 583143af14a645238262214515ee148f Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.845530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7'} Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:19:30.846255 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.847429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.850486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Returning 404 to user: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:19:30.852360 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9e436f9f-fceb-4ab9-a68b-c47747a00174 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 404 len: 111 microversion: 2.1 time: 0.045634 Jul 12 07:19:30.856313 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 396/786] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:19:30 2022] DELETE /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:19:30.862417 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:30.863749 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] [instance: aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:30.870919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:30.871712 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:30.872721 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:30.873395 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:30.895344 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] HTTP exception thrown: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Request method failure captured: Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 HTTP/1.1 Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8KYjPkdJ43t88kh-kC7MeiVe2L7S7xD28zModJqTETNXQzVeciG8G6d95pLBwCJG2EpfLLrqW0rBC9Q0_NfWZB_v4CmQq0vVZRlmEq3l75cmkr0jM8dcdbf4e_QJQ0AmxJf2DTY561h75jhdbu9UtbGrBKxvSbTRYJ-1ET2tGTQ3Y Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:19:30.897278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6be635735d174893be20f99110cacbfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6be635735d174893be20f99110cacbfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6be635735d174893be20f99110cacbfa"}]}] Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 6be635735d174893be20f99110cacbfa Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2005227259 Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 583143af14a645238262214515ee148f Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeTestJSON-2005227259-project Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.898672 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7'} Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:19:30.903289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. Jul 12 07:19:30.904567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:19:30.905670 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] Returning 404 to user: Instance aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:19:30.905670 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f24a5616-c7cd-4b05-ad09-359a5af44895 tempest-AttachVolumeTestJSON-2005227259 tempest-AttachVolumeTestJSON-2005227259-project] 10.222.0.25 "GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7" status: 404 len: 111 microversion: 2.1 time: 0.041330 Jul 12 07:19:30.905670 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 391/787] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:30 2022] GET /compute/v2.1/servers/aed66c6c-e97f-4c81-9c5a-aa5c5b5db8e7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 07:19:31.519385 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:31.519991 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:31.538915 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:31.539365 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:31.540134 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:31.540568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:31.758965 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:31.775204 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:31.776693 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:31.777883 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cbd367dc-3be7-44b7-a73e-5b01d39624bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.263443 Jul 12 07:19:31.778434 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 397/788] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:31 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:32.802281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:32.805662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:32.808427 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:32.813839 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:32.814294 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:32.816072 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:32.816497 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:33.063025 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:33.072870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:33.081121 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:33.082662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-976e6ca6-95c6-408d-b10f-9c957807fd94 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.290888 Jul 12 07:19:33.101574 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 392/789] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:32 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:34.125660 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:34.127204 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:34.134599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:34.141721 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:34.143484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:34.144080 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:34.361346 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:34.369467 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:34.370967 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:34.372123 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bcc2abfd-fa26-4e95-8d45-a742941f1ee0 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.251452 Jul 12 07:19:34.372690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 398/790] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:34 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:35.391968 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:35.392597 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:35.403867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:35.404306 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:35.405096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:35.405531 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:35.630882 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:35.649774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:35.654341 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:35.657651 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2bcccf12-f118-4488-b626-c2ccafd01ca5 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.270255 Jul 12 07:19:35.658352 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 393/791] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:35 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:36.676176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:36.676790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:36.683097 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:36.683534 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:36.684285 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:36.684708 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:36.835608 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:36.845010 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:36.846552 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:36.847792 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-89596f85-709d-49dd-82fb-0ef3670ccbcb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.175542 Jul 12 07:19:36.848351 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 399/792] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:36 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:37.866585 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:37.867041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:37.874700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:37.875302 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:37.876059 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:37.876489 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:38.010757 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:38.019013 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:38.020501 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:38.021678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e770fb62-1504-47cc-a335-c81fae99bbfb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.159271 Jul 12 07:19:38.022258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 394/793] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:37 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:39.040094 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:39.040796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:39.047690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:39.048128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:39.048886 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:39.049338 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:39.196591 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:39.206119 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:39.208124 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:39.209571 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a2def698-79ca-4db4-b84e-f4e8b04f7743 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.173336 Jul 12 07:19:39.210227 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 400/794] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:39 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:40.233671 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:40.233671 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:40.237913 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:40.238443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:40.239459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:40.239955 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:40.403272 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:40.412143 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:40.413910 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:40.415061 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2abeda7a-8b02-405d-b8c5-d47a2e864957 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.189869 Jul 12 07:19:40.415940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 395/795] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:40 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:41.433037 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:41.433805 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:41.440613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:41.441067 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:41.441853 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:41.442290 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:41.585367 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:41.589927 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:41.596557 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:41.598629 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:41.600248 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5ecfd17e-7605-4091-a15b-a5e8bcf62321 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.171155 Jul 12 07:19:41.601452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 401/796] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:41 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:42.458096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-dd50ec47-025e-46c0-ba7a-1f0226659150 req-8d0ece0c-7a06-4f57-8bb4-492f361a61a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8a7f04-501d-4547-b7ca-9e19f7d59c32", "name": "network-vif-plugged", "status": "completed", "tag": "3564b5da-8b1e-491d-b0b1-502090eeb718"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:19:42.472096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-dd50ec47-025e-46c0-ba7a-1f0226659150 req-8d0ece0c-7a06-4f57-8bb4-492f361a61a7 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:42.473523 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-dd50ec47-025e-46c0-ba7a-1f0226659150 req-8d0ece0c-7a06-4f57-8bb4-492f361a61a7 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:42.492528 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-dd50ec47-025e-46c0-ba7a-1f0226659150 req-8d0ece0c-7a06-4f57-8bb4-492f361a61a7 service nova] Creating event network-vif-plugged:3564b5da-8b1e-491d-b0b1-502090eeb718 for instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 on hv-cinder-82549 Jul 12 07:19:42.497922 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-dd50ec47-025e-46c0-ba7a-1f0226659150 req-8d0ece0c-7a06-4f57-8bb4-492f361a61a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045747 Jul 12 07:19:42.498720 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 396/797] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:42.619734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:42.620332 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:42.628121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:42.628661 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:42.629511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:42.630131 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:42.778479 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:42.787783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:42.789353 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:42.790681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cfbfac77-e96e-4ffb-b8c5-91b97e72175b tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.175235 Jul 12 07:19:42.794759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 402/798] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:42 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:19:43.809921 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:43.810665 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:43.817498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:43.817943 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:43.818703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:43.819134 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:43.957455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:43.971110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:43.973284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:43.973284 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ede9f899-de05-44ff-afab-376d813e262a tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.167820 Jul 12 07:19:43.973770 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 397/799] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:43 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:44.991746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:44.992384 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:44.999370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:44.999808 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:45.000684 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:45.001796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:45.159320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:45.168484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:45.180663 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:45.182184 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b498279-0296-44e2-abe0-a36ebcdde2bb tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1733 microversion: 2.20 time: 0.194374 Jul 12 07:19:45.199611 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 403/800] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:44 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:46.207172 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:46.207877 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:46.214837 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:46.215280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:46.216039 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:46.216468 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:46.250608 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2216aa1f-92b5-4cad-9634-a06d64256cb7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:46.251078 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2216aa1f-92b5-4cad-9634-a06d64256cb7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:46.263661 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2216aa1f-92b5-4cad-9634-a06d64256cb7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:46.263851 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2216aa1f-92b5-4cad-9634-a06d64256cb7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:46.264891 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2216aa1f-92b5-4cad-9634-a06d64256cb7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:46.265390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2216aa1f-92b5-4cad-9634-a06d64256cb7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:46.310956 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2216aa1f-92b5-4cad-9634-a06d64256cb7 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/ips" status: 200 len: 149 microversion: 2.1 time: 0.064086 Jul 12 07:19:46.311848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 404/801] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:19:46 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/ips => generated 149 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:46.362272 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:46.372505 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:46.375509 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:46.377907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0d810b04-9e4e-4d03-aff5-baf83133d398 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1720 microversion: 2.20 time: 0.174464 Jul 12 07:19:46.378952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 398/802] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:19:46 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:19:47.857894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eb3a3098-693f-4f4c-afd7-d07a10dd0f77 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "466ff1b2-3bdb-4daa-b9df-573faecd301b"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:19:47.859092 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eb3a3098-693f-4f4c-afd7-d07a10dd0f77 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:47.866529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb3a3098-693f-4f4c-afd7-d07a10dd0f77 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:47.867139 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb3a3098-693f-4f4c-afd7-d07a10dd0f77 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:47.868094 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb3a3098-693f-4f4c-afd7-d07a10dd0f77 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:47.868520 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb3a3098-693f-4f4c-afd7-d07a10dd0f77 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:48.164797 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eb3a3098-693f-4f4c-afd7-d07a10dd0f77 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "POST /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310467 Jul 12 07:19:48.166435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 405/803] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:19:47 2022] POST /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:55.851894 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-cb724d78-3c1e-4947-8f10-f500fa323a3b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:55.852486 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-cb724d78-3c1e-4947-8f10-f500fa323a3b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:55.859379 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cb724d78-3c1e-4947-8f10-f500fa323a3b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:55.859790 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cb724d78-3c1e-4947-8f10-f500fa323a3b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:55.860556 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cb724d78-3c1e-4947-8f10-f500fa323a3b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:55.860989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-cb724d78-3c1e-4947-8f10-f500fa323a3b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:55.863702 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:55.945679 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-cb724d78-3c1e-4947-8f10-f500fa323a3b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lazy-loading 'services' on Instance uuid 40b134f1-4e3a-442b-a5e0-010fcd684bf3 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:19:56.030842 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-cb724d78-3c1e-4947-8f10-f500fa323a3b tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-volume_attachments/466ff1b2-3bdb-4daa-b9df-573faecd301b" status: 202 len: 0 microversion: 2.1 time: 0.184118 Jul 12 07:19:56.031455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 399/804] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:19:55 2022] DELETE /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-volume_attachments/466ff1b2-3bdb-4daa-b9df-573faecd301b => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:19:56.040680 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c05d3f6c-1551-4533-be32-6388c380cf65 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:56.042511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c05d3f6c-1551-4533-be32-6388c380cf65 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:56.048481 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=38 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:56.050731 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05d3f6c-1551-4533-be32-6388c380cf65 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:56.051161 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05d3f6c-1551-4533-be32-6388c380cf65 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:56.052046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05d3f6c-1551-4533-be32-6388c380cf65 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:56.052504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05d3f6c-1551-4533-be32-6388c380cf65 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:56.084769 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c05d3f6c-1551-4533-be32-6388c380cf65 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048584 Jul 12 07:19:56.085383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 406/805] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:19:56 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:19:57.096969 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e8cd31fb-5e49-4a35-9fc2-19cff2fbefb9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:57.098087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e8cd31fb-5e49-4a35-9fc2-19cff2fbefb9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:57.105341 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8cd31fb-5e49-4a35-9fc2-19cff2fbefb9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:57.105889 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8cd31fb-5e49-4a35-9fc2-19cff2fbefb9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:57.106809 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8cd31fb-5e49-4a35-9fc2-19cff2fbefb9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:57.107312 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e8cd31fb-5e49-4a35-9fc2-19cff2fbefb9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:57.140771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e8cd31fb-5e49-4a35-9fc2-19cff2fbefb9 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048506 Jul 12 07:19:57.143168 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 400/806] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:19:57 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:19:57.244294 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-11956808-e5f1-49ba-81da-8feb88fe493c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:57.244821 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-11956808-e5f1-49ba-81da-8feb88fe493c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:57.251743 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11956808-e5f1-49ba-81da-8feb88fe493c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:57.252180 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11956808-e5f1-49ba-81da-8feb88fe493c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:57.252935 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11956808-e5f1-49ba-81da-8feb88fe493c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:57.253369 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11956808-e5f1-49ba-81da-8feb88fe493c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:57.280500 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-11956808-e5f1-49ba-81da-8feb88fe493c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:19:57.367746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-11956808-e5f1-49ba-81da-8feb88fe493c tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 204 len: 0 microversion: 2.1 time: 0.126700 Jul 12 07:19:57.368619 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 407/807] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:19:57 2022] DELETE /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:19:57.376653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3ede3eb5-fb5a-4b0e-9e1b-5f4ffc6d5ce4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:57.377544 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3ede3eb5-fb5a-4b0e-9e1b-5f4ffc6d5ce4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:57.385306 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ede3eb5-fb5a-4b0e-9e1b-5f4ffc6d5ce4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:57.385734 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ede3eb5-fb5a-4b0e-9e1b-5f4ffc6d5ce4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:57.386499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ede3eb5-fb5a-4b0e-9e1b-5f4ffc6d5ce4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:57.386925 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ede3eb5-fb5a-4b0e-9e1b-5f4ffc6d5ce4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:57.524072 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3ede3eb5-fb5a-4b0e-9e1b-5f4ffc6d5ce4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:57.534940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3ede3eb5-fb5a-4b0e-9e1b-5f4ffc6d5ce4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1680 microversion: 2.1 time: 0.162148 Jul 12 07:19:57.535662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 401/808] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:57 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:19:58.553097 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bceda2e4-1f94-48cb-84a6-b3e764ae5f62 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:58.553789 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bceda2e4-1f94-48cb-84a6-b3e764ae5f62 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:58.561064 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bceda2e4-1f94-48cb-84a6-b3e764ae5f62 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:58.561553 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bceda2e4-1f94-48cb-84a6-b3e764ae5f62 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:58.562529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bceda2e4-1f94-48cb-84a6-b3e764ae5f62 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:58.563216 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bceda2e4-1f94-48cb-84a6-b3e764ae5f62 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:58.707986 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bceda2e4-1f94-48cb-84a6-b3e764ae5f62 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:58.714177 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bceda2e4-1f94-48cb-84a6-b3e764ae5f62 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1680 microversion: 2.1 time: 0.165495 Jul 12 07:19:58.714754 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 408/809] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:58 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:19:59.731822 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-eb5ea418-6b2b-4cb3-b02e-fada485cbd7e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:19:59.732499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-eb5ea418-6b2b-4cb3-b02e-fada485cbd7e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:19:59.738900 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb5ea418-6b2b-4cb3-b02e-fada485cbd7e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:59.739348 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb5ea418-6b2b-4cb3-b02e-fada485cbd7e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:59.740103 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb5ea418-6b2b-4cb3-b02e-fada485cbd7e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:19:59.740529 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eb5ea418-6b2b-4cb3-b02e-fada485cbd7e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:19:59.875946 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-eb5ea418-6b2b-4cb3-b02e-fada485cbd7e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:19:59.884302 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-eb5ea418-6b2b-4cb3-b02e-fada485cbd7e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1680 microversion: 2.1 time: 0.156366 Jul 12 07:19:59.885172 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 402/810] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:19:59 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:00.893656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-2319ec62-a45a-45d2-81b8-1f528f3cd052 req-6203887d-2183-4cae-ba82-7c228c168252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b134f1-4e3a-442b-a5e0-010fcd684bf3", "name": "network-vif-deleted", "tag": "47d43779-dabb-41eb-b293-4fa84b815c86"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:00.901820 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5b484b94-703e-4911-aed1-f17a9d083ad8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:00.902609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5b484b94-703e-4911-aed1-f17a9d083ad8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:00.913534 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5b484b94-703e-4911-aed1-f17a9d083ad8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:00.913737 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-2319ec62-a45a-45d2-81b8-1f528f3cd052 req-6203887d-2183-4cae-ba82-7c228c168252 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:00.914321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5b484b94-703e-4911-aed1-f17a9d083ad8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:00.914668 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-2319ec62-a45a-45d2-81b8-1f528f3cd052 req-6203887d-2183-4cae-ba82-7c228c168252 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:00.915459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5b484b94-703e-4911-aed1-f17a9d083ad8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:00.916525 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5b484b94-703e-4911-aed1-f17a9d083ad8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:00.928588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-2319ec62-a45a-45d2-81b8-1f528f3cd052 req-6203887d-2183-4cae-ba82-7c228c168252 service nova] Creating event network-vif-deleted:47d43779-dabb-41eb-b293-4fa84b815c86 for instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 on hv-cinder-82549 Jul 12 07:20:00.934407 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-2319ec62-a45a-45d2-81b8-1f528f3cd052 req-6203887d-2183-4cae-ba82-7c228c168252 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044541 Jul 12 07:20:00.935591 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 409/811] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:00.980956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5b484b94-703e-4911-aed1-f17a9d083ad8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:00.992021 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5b484b94-703e-4911-aed1-f17a9d083ad8 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1612 microversion: 2.1 time: 0.093940 Jul 12 07:20:00.998722 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 403/812] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:00 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1612 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:20:02.011746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:02.012449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:02.018822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:02.019265 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:02.020032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:02.020425 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:02.056503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:02.056935 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:02.057406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lazy-loading 'fault' on Instance uuid 40b134f1-4e3a-442b-a5e0-010fcd684bf3 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:20:02.115330 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef6395fa14b54c43931ffeaab023d97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e5f4c43a3469db851b4704f422448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:02.123490 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a0ee3c44-a781-433b-91e1-8cb2e14b856d tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 200 len: 1330 microversion: 2.1 time: 0.117687 Jul 12 07:20:02.124063 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 410/813] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:02 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:03.141839 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:03.142239 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:03.144368 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=24 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:03.150510 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:03.151020 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:03.151867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:03.152285 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:03.168953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 HTTP/1.1 Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:20:03.169753 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:03.171331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '40b134f1-4e3a-442b-a5e0-010fcd684bf3'} Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:03.172676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:03.174098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:03.175434 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:03.175434 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3907e6c3-a8ca-4bd4-b18a-e517d5f7783f tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 404 len: 111 microversion: 2.1 time: 0.033773 Jul 12 07:20:03.175434 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 404/814] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:03 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:03.181220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ad7bf4f5-80f6-4f2e-abf4-a7f027e216ea tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '.version_select at 0x7f70116b3790>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:03.206012 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ad7bf4f5-80f6-4f2e-abf4-a7f027e216ea tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954010994" status: 202 len: 0 microversion: 2.1 time: 0.029647 Jul 12 07:20:03.206860 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 411/815] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 12 07:20:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954010994 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:20:05.012144 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:05.013280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:05.019920 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:05.020361 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:05.021325 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:05.021909 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:05.037088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 HTTP/1.1 Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:20:05.038620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.040326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '40b134f1-4e3a-442b-a5e0-010fcd684bf3'} Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:05.041281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.043066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.045245 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:05.045245 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1cffff31-60e5-4da2-85ef-dbd70bda5998 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 404 len: 111 microversion: 2.1 time: 0.032457 Jul 12 07:20:05.045245 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 405/816] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:20:05 2022] DELETE /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:05.050515 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:05.051131 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: 40b134f1-4e3a-442b-a5e0-010fcd684bf3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:05.059752 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:05.060197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:05.060961 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:05.061410 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:05.076054 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 HTTP/1.1 Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:05.077746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.079007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '40b134f1-4e3a-442b-a5e0-010fcd684bf3'} Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:05.083555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. Jul 12 07:20:05.085341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:05.087118 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance 40b134f1-4e3a-442b-a5e0-010fcd684bf3 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:05.087118 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6ab2d318-ed57-40a8-84d5-6d74a6bf3c5e tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3" status: 404 len: 111 microversion: 2.1 time: 0.033495 Jul 12 07:20:05.087118 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 412/817] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:05 2022] GET /compute/v2.1/servers/40b134f1-4e3a-442b-a5e0-010fcd684bf3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 07:20:06.232385 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:06.232972 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:06.240222 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:06.240717 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:06.241680 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:06.242262 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:06.257766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca HTTP/1.1 Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:20:06.259439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.261441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'f428539a-0743-4d98-889b-0c2e7f7ae5ca'} Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:06.265326 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.266774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.268219 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:06.268219 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-23a8317b-7f77-4191-83c3-27b7edb4bdaf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 404 len: 111 microversion: 2.1 time: 0.033251 Jul 12 07:20:06.268219 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 406/818] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:20:06 2022] DELETE /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:06.269555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:06.270144 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: f428539a-0743-4d98-889b-0c2e7f7ae5ca] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:06.276817 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:06.277368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:06.278146 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:06.278617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:06.294078 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca HTTP/1.1 Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:06.295786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.297567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'f428539a-0743-4d98-889b-0c2e7f7ae5ca'} Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:06.298590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. Jul 12 07:20:06.302944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.304220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance f428539a-0743-4d98-889b-0c2e7f7ae5ca could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:06.304220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e08e1355-5bcc-4a11-b940-520cb4f09f78 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca" status: 404 len: 111 microversion: 2.1 time: 0.032729 Jul 12 07:20:06.304220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 413/819] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:06 2022] GET /compute/v2.1/servers/f428539a-0743-4d98-889b-0c2e7f7ae5ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:06.308959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:06.309645 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:06.316509 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:06.316953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:06.318162 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:06.318685 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 HTTP/1.1 Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:20:06.336014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.337703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'eceb7063-d7f3-4616-93d5-661faeb663d2'} Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:06.342959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.344767 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.346881 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:06.346881 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5524a6a0-8f63-4453-a50a-01228fccc4cf tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 404 len: 111 microversion: 2.1 time: 0.032843 Jul 12 07:20:06.346881 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 407/820] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:20:06 2022] DELETE /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:06.347619 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:06.348307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: eceb7063-d7f3-4616-93d5-661faeb663d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:06.358329 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:06.358769 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:06.361444 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:06.362130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:06.393600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 HTTP/1.1 Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:06.395358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.397262 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'eceb7063-d7f3-4616-93d5-661faeb663d2'} Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:06.398169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. Jul 12 07:20:06.399609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:06.400798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance eceb7063-d7f3-4616-93d5-661faeb663d2 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:06.400798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-39a521ce-36a7-4f63-9c75-091daf15a97a tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2" status: 404 len: 111 microversion: 2.1 time: 0.053545 Jul 12 07:20:06.400798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 414/821] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:06 2022] GET /compute/v2.1/servers/eceb7063-d7f3-4616-93d5-661faeb663d2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:07.558928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:07.559499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:07.566711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:07.567233 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:07.568066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:07.568588 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:07.583902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 HTTP/1.1 Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:20:07.585478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.587114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'e99231ef-ba9f-4294-87ab-e47992b4f001'} Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:07.591759 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.593256 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.595093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:07.595093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b7c6680b-a828-4575-8e86-d122c33f16e4 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 404 len: 111 microversion: 2.1 time: 0.032351 Jul 12 07:20:07.595093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 408/822] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:20:07 2022] DELETE /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 07:20:07.596344 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:07.596970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] [instance: e99231ef-ba9f-4294-87ab-e47992b4f001] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:07.605784 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:07.606388 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:07.607162 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:07.607600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:07.621707 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] HTTP exception thrown: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Request method failure captured: Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 HTTP/1.1 Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8MOVhVSS_GwlrwS4qhGyeSATGK_vhsJUNcRzXV4Y0m298RVouK7t0RyeG8YNpQ7fiHbvzrKEegiMHpG1aTIGD7gcKOAhpj53EO_e_jVscjZV_IwFjaoXCBF9sI6-43PGqQ4L9D8UJ8852vYTvjkK_oKumyZymiO5Z4CrfjYH-5Lmg Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:07.623267 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b52e5f4c43a3469db851b4704f422448"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b52e5f4c43a3469db851b4704f422448"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b52e5f4c43a3469db851b4704f422448"}]}] Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: b52e5f4c43a3469db851b4704f422448 Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1520393880 Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: ef6395fa14b54c43931ffeaab023d97c Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeNegativeTest-1520393880-project Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.624848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'e99231ef-ba9f-4294-87ab-e47992b4f001'} Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:07.625766 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. Jul 12 07:20:07.627252 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:07.628555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] Returning 404 to user: Instance e99231ef-ba9f-4294-87ab-e47992b4f001 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:07.628555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bf9b88c3-2929-4511-8a80-137a54fa6107 tempest-AttachVolumeNegativeTest-1520393880 tempest-AttachVolumeNegativeTest-1520393880-project] 10.222.0.25 "GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001" status: 404 len: 111 microversion: 2.1 time: 0.032722 Jul 12 07:20:07.628555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 415/823] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:07 2022] GET /compute/v2.1/servers/e99231ef-ba9f-4294-87ab-e47992b4f001 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:08.665986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1978929147", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "networks": [{"uuid": "e4a6e019-8a65-4f37-835f-6edd447d396e"}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:08.736464 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] validate_networks() for [('e4a6e019-8a65-4f37-835f-6edd447d396e', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:20:09.376383 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:20:09.376768 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:20:09.377283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:20:09.377680 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:20:09.378070 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:20:09.388325 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:09.388772 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:09.389636 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:09.390100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:09.409909 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Getting quotas for project f15d014b88a444c28ae32f230d144e8c. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:20:09.414802 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Getting quotas for user 7e060034139f420e8412b8a55f1b29a2 and project f15d014b88a444c28ae32f230d144e8c. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:20:09.428218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:20:09.430455 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:20:09.476283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c570d91b-1b36-41b1-bd12-e040e0f8209d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813961 Jul 12 07:20:09.476915 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 409/824] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:20:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:20:09.487465 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1769cfef-76eb-45b2-be13-129293951657 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:09.488339 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1769cfef-76eb-45b2-be13-129293951657 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:09.564175 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1769cfef-76eb-45b2-be13-129293951657 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:09.571806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1769cfef-76eb-45b2-be13-129293951657 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1219 microversion: 2.1 time: 0.088373 Jul 12 07:20:09.581090 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 416/825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:09 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:10.591296 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-38a4d3f3-5b80-4aec-a631-87c9691a4f9d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:10.591916 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-38a4d3f3-5b80-4aec-a631-87c9691a4f9d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:10.598292 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-38a4d3f3-5b80-4aec-a631-87c9691a4f9d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:10.598739 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-38a4d3f3-5b80-4aec-a631-87c9691a4f9d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:10.599524 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-38a4d3f3-5b80-4aec-a631-87c9691a4f9d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:10.599971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-38a4d3f3-5b80-4aec-a631-87c9691a4f9d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:10.687051 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-38a4d3f3-5b80-4aec-a631-87c9691a4f9d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:10.698064 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-38a4d3f3-5b80-4aec-a631-87c9691a4f9d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1215 microversion: 2.1 time: 0.111412 Jul 12 07:20:10.699388 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 410/826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:10 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:11.717203 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-39e71a16-c065-4001-9bcc-10c81e5b6722 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:11.717863 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-39e71a16-c065-4001-9bcc-10c81e5b6722 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:11.725801 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39e71a16-c065-4001-9bcc-10c81e5b6722 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:11.726320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39e71a16-c065-4001-9bcc-10c81e5b6722 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:11.727400 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39e71a16-c065-4001-9bcc-10c81e5b6722 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:11.727894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39e71a16-c065-4001-9bcc-10c81e5b6722 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:11.820179 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-39e71a16-c065-4001-9bcc-10c81e5b6722 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:11.832789 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-39e71a16-c065-4001-9bcc-10c81e5b6722 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1277 microversion: 2.1 time: 0.119828 Jul 12 07:20:11.842409 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 417/827] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:11 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:12.852957 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9ce5188b-53da-41d9-8744-07f561208c97 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:12.854156 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9ce5188b-53da-41d9-8744-07f561208c97 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:12.867258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ce5188b-53da-41d9-8744-07f561208c97 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:12.867802 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ce5188b-53da-41d9-8744-07f561208c97 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:12.869000 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ce5188b-53da-41d9-8744-07f561208c97 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:12.869638 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9ce5188b-53da-41d9-8744-07f561208c97 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:12.881989 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-c7a26747-ef07-4ac5-991c-34c61650892b req-f8b41e18-8a70-4f00-90a2-e65e9998e309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5494aff2-8e9a-4813-b65a-ff9c39f056a6", "tag": "1f83cf7e-e488-47bb-99f5-cd1a1226c55c"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:12.895823 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-c7a26747-ef07-4ac5-991c-34c61650892b req-f8b41e18-8a70-4f00-90a2-e65e9998e309 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:12.896574 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-c7a26747-ef07-4ac5-991c-34c61650892b req-f8b41e18-8a70-4f00-90a2-e65e9998e309 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:12.908065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:12.910628 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-c7a26747-ef07-4ac5-991c-34c61650892b req-f8b41e18-8a70-4f00-90a2-e65e9998e309 service nova] Creating event network-changed:1f83cf7e-e488-47bb-99f5-cd1a1226c55c for instance 5494aff2-8e9a-4813-b65a-ff9c39f056a6 on hv-cinder-82549 Jul 12 07:20:12.916494 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-c7a26747-ef07-4ac5-991c-34c61650892b req-f8b41e18-8a70-4f00-90a2-e65e9998e309 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038089 Jul 12 07:20:12.917311 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 418/828] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:20:13.063166 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dbb43992-a6c1-4443-b5df-dcc8ce7108e2 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Action: 'create', calling method: .version_select at 0x7f70116548b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1991414350", "metadata": {"Type": "work"}}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dbb43992-a6c1-4443-b5df-dcc8ce7108e2 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Request method failure captured: Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 122 Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSCsIFGfDAsIFpp4pmykljH9-yeRlIzdW8vdCqwcBZk8HrkZBSiMf6tw5CQohHgXr8Y4H5yerasnvjh4gaFxb4qxq07llVQKTwrTLoSAV0WaP6Pwl9XM-ROE5Drr1smoOw-03pwPtaHCGfpshU_NAqf_yca-UVbth3UdVEZLg_GcFjk Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:13.086391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8fb3fd6cb2f643d9adb56409a6b98341"}]}] Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: f056820fb03e45eda2b3b76cad60ed95 Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1991414350", "metadata": {"Type": "work"}}} Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: Jul 12 07:20:13.087918 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1991414350', 'metadata': {'Type': 'work'}}}} Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise error Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:13.088842 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 07:20:13.090588 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 07:20:13.091932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 07:20:13.091932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.091932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dbb43992-a6c1-4443-b5df-dcc8ce7108e2 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:13.091932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dbb43992-a6c1-4443-b5df-dcc8ce7108e2 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.169518 Jul 12 07:20:13.091932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 419/829] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 12 07:20:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:20:13.097615 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf195a2c-c946-4778-9910-91381c0c3963 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Action: 'create', calling method: .version_select at 0x7f70116b3820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2014485867", "metadata": {"Type": "work"}}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf195a2c-c946-4778-9910-91381c0c3963 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Request method failure captured: Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 120 Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSCsIFGfDAsIFpp4pmykljH9-yeRlIzdW8vdCqwcBZk8HrkZBSiMf6tw5CQohHgXr8Y4H5yerasnvjh4gaFxb4qxq07llVQKTwrTLoSAV0WaP6Pwl9XM-ROE5Drr1smoOw-03pwPtaHCGfpshU_NAqf_yca-UVbth3UdVEZLg_GcFjk Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:13.100081 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8fb3fd6cb2f643d9adb56409a6b98341"}]}] Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: f056820fb03e45eda2b3b76cad60ed95 Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2014485867", "metadata": {"Type": "work"}}} Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: Jul 12 07:20:13.101812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2014485867', 'metadata': {'Type': 'work'}}}} Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise error Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi '0' Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:13.107062 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 07:20:13.108675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 07:20:13.110214 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 07:20:13.110214 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.110214 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf195a2c-c946-4778-9910-91381c0c3963 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:13.110214 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cf195a2c-c946-4778-9910-91381c0c3963 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007447 Jul 12 07:20:13.110214 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 420/830] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 12 07:20:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 07:20:13.112611 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c7f9ded7-da08-4b6c-841b-5ee71e57cfec tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Action: 'create', calling method: .version_select at 0x7f70116b3160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1057394563", "metadata": {"Type": "work"}}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:13.112797 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9ce5188b-53da-41d9-8744-07f561208c97 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c7f9ded7-da08-4b6c-841b-5ee71e57cfec tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Request method failure captured: Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 119 Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSCsIFGfDAsIFpp4pmykljH9-yeRlIzdW8vdCqwcBZk8HrkZBSiMf6tw5CQohHgXr8Y4H5yerasnvjh4gaFxb4qxq07llVQKTwrTLoSAV0WaP6Pwl9XM-ROE5Drr1smoOw-03pwPtaHCGfpshU_NAqf_yca-UVbth3UdVEZLg_GcFjk Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:13.125857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8fb3fd6cb2f643d9adb56409a6b98341"}]}] Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: f056820fb03e45eda2b3b76cad60ed95 Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1057394563", "metadata": {"Type": "work"}}} Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: Jul 12 07:20:13.127977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1057394563', 'metadata': {'Type': 'work'}}}} Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise error Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi '' Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:13.128909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 07:20:13.130613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 07:20:13.131977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 07:20:13.131977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.131977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c7f9ded7-da08-4b6c-841b-5ee71e57cfec tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:13.131977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c7f9ded7-da08-4b6c-841b-5ee71e57cfec tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009456 Jul 12 07:20:13.131977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 421/831] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 12 07:20:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:20:13.131977 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8dddb427-8d3a-45ad-b6d1-d9d68cc1561d tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Calling method '.version_select at 0x7f70117274c0>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:13.132502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9ce5188b-53da-41d9-8744-07f561208c97 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1319 microversion: 2.1 time: 0.282421 Jul 12 07:20:13.132502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 411/832] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:12 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:13.164084 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-8dddb427-8d3a-45ad-b6d1-d9d68cc1561d tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] HTTP exception thrown: Volume tempest-invalid-1522174226 could not be found. Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8dddb427-8d3a-45ad-b6d1-d9d68cc1561d tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Request method failure captured: Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1522174226 HTTP/1.1 Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSCsIFGfDAsIFpp4pmykljH9-yeRlIzdW8vdCqwcBZk8HrkZBSiMf6tw5CQohHgXr8Y4H5yerasnvjh4gaFxb4qxq07llVQKTwrTLoSAV0WaP6Pwl9XM-ROE5Drr1smoOw-03pwPtaHCGfpshU_NAqf_yca-UVbth3UdVEZLg_GcFjk Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:13.166126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8fb3fd6cb2f643d9adb56409a6b98341"}]}] Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: f056820fb03e45eda2b3b76cad60ed95 Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Volume tempest-invalid-1522174226 could not be found. Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'tempest-invalid-1522174226'} Jul 12 07:20:13.167825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1522174226 could not be found. (HTTP 404) (Request-ID: req-ffe2efdf-87b7-4fce-9f7e-5b6b161eea53) Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.168685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 07:20:13.169983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1522174226 could not be found. Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:13.171245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1522174226 could not be found. Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1522174226 could not be found. Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8dddb427-8d3a-45ad-b6d1-d9d68cc1561d tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Returning 404 to user: Volume tempest-invalid-1522174226 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8dddb427-8d3a-45ad-b6d1-d9d68cc1561d tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1522174226" status: 404 len: 99 microversion: 2.1 time: 0.043779 Jul 12 07:20:13.172491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 422/833] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 12 07:20:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1522174226 => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 12 07:20:13.177470 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-274131a3-cf94-4185-bccc-0caecb6202c0 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003786 Jul 12 07:20:13.177981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 412/834] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Jul 12 07:20:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 07:20:13.189022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8aba87ad-6c51-4140-939a-e4c49fe2ab14 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004555 Jul 12 07:20:13.189702 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 423/835] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 12 07:20:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 07:20:13.198543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-60093b48-bb2f-4364-8afc-441e3ea41595 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Calling method '.version_select at 0x7f70116159d0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:13.236381 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-60093b48-bb2f-4364-8afc-441e3ea41595 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] HTTP exception thrown: Volume b24933ff-4682-4aff-9660-1ddcb654bfb6 could not be found. Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-60093b48-bb2f-4364-8afc-441e3ea41595 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Request method failure captured: Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/os-volumes/b24933ff-4682-4aff-9660-1ddcb654bfb6 HTTP/1.1 Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizSCsIFGfDAsIFpp4pmykljH9-yeRlIzdW8vdCqwcBZk8HrkZBSiMf6tw5CQohHgXr8Y4H5yerasnvjh4gaFxb4qxq07llVQKTwrTLoSAV0WaP6Pwl9XM-ROE5Drr1smoOw-03pwPtaHCGfpshU_NAqf_yca-UVbth3UdVEZLg_GcFjk Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:20:13.238818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8fb3fd6cb2f643d9adb56409a6b98341"}]}] Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: f056820fb03e45eda2b3b76cad60ed95 Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Volume b24933ff-4682-4aff-9660-1ddcb654bfb6 could not be found. Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'b24933ff-4682-4aff-9660-1ddcb654bfb6'} Jul 12 07:20:13.240387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b24933ff-4682-4aff-9660-1ddcb654bfb6 could not be found. (HTTP 404) (Request-ID: req-22bb7b20-7483-491c-b8e6-2dc815d7f30f) Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.241343 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 07:20:13.242924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b24933ff-4682-4aff-9660-1ddcb654bfb6 could not be found. Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 07:20:13.244169 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b24933ff-4682-4aff-9660-1ddcb654bfb6 could not be found. Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b24933ff-4682-4aff-9660-1ddcb654bfb6 could not be found. Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-60093b48-bb2f-4364-8afc-441e3ea41595 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Returning 404 to user: Volume b24933ff-4682-4aff-9660-1ddcb654bfb6 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-60093b48-bb2f-4364-8afc-441e3ea41595 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/b24933ff-4682-4aff-9660-1ddcb654bfb6" status: 404 len: 109 microversion: 2.1 time: 0.049167 Jul 12 07:20:13.246512 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 413/836] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:20:13 2022] DELETE /compute/v2.1/os-volumes/b24933ff-4682-4aff-9660-1ddcb654bfb6 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:13.254541 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-caab80c1-9166-4a5e-8d87-ae28faeefa65 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Calling method '.version_select at 0x7f70118c0c10>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:13.283501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-caab80c1-9166-4a5e-8d87-ae28faeefa65 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] HTTP exception thrown: Volume 9a011065-cf89-45ad-8bce-b8ef7ffc85b1 could not be found. Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-caab80c1-9166-4a5e-8d87-ae28faeefa65 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Request method failure captured: Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/os-volumes/9a011065-cf89-45ad-8bce-b8ef7ffc85b1 HTTP/1.1 Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSCsIFGfDAsIFpp4pmykljH9-yeRlIzdW8vdCqwcBZk8HrkZBSiMf6tw5CQohHgXr8Y4H5yerasnvjh4gaFxb4qxq07llVQKTwrTLoSAV0WaP6Pwl9XM-ROE5Drr1smoOw-03pwPtaHCGfpshU_NAqf_yca-UVbth3UdVEZLg_GcFjk Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:13.286834 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8fb3fd6cb2f643d9adb56409a6b98341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8fb3fd6cb2f643d9adb56409a6b98341"}]}] Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 8fb3fd6cb2f643d9adb56409a6b98341 Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesNegativeTest-2109202228 Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: f056820fb03e45eda2b3b76cad60ed95 Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesNegativeTest-2109202228-project Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Volume 9a011065-cf89-45ad-8bce-b8ef7ffc85b1 could not be found. Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '9a011065-cf89-45ad-8bce-b8ef7ffc85b1'} Jul 12 07:20:13.288435 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a011065-cf89-45ad-8bce-b8ef7ffc85b1 could not be found. (HTTP 404) (Request-ID: req-bd3e5688-96e9-4d6b-8ddd-44b7a2d23415) Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.289654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:20:13.291026 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a011065-cf89-45ad-8bce-b8ef7ffc85b1 could not be found. Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 07:20:13.292406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a011065-cf89-45ad-8bce-b8ef7ffc85b1 could not be found. Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a011065-cf89-45ad-8bce-b8ef7ffc85b1 could not be found. Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-caab80c1-9166-4a5e-8d87-ae28faeefa65 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] Returning 404 to user: Volume 9a011065-cf89-45ad-8bce-b8ef7ffc85b1 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-caab80c1-9166-4a5e-8d87-ae28faeefa65 tempest-VolumesNegativeTest-2109202228 tempest-VolumesNegativeTest-2109202228-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9a011065-cf89-45ad-8bce-b8ef7ffc85b1" status: 404 len: 109 microversion: 2.1 time: 0.037666 Jul 12 07:20:13.293749 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 424/837] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:20:13 2022] GET /compute/v2.1/os-volumes/9a011065-cf89-45ad-8bce-b8ef7ffc85b1 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:14.147212 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4478ac65-2d69-45a9-9674-eac22afb12fd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:14.147828 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4478ac65-2d69-45a9-9674-eac22afb12fd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:14.154819 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4478ac65-2d69-45a9-9674-eac22afb12fd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:14.155257 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4478ac65-2d69-45a9-9674-eac22afb12fd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:14.156117 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4478ac65-2d69-45a9-9674-eac22afb12fd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:14.156553 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4478ac65-2d69-45a9-9674-eac22afb12fd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:14.292496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4478ac65-2d69-45a9-9674-eac22afb12fd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:14.300095 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4478ac65-2d69-45a9-9674-eac22afb12fd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1319 microversion: 2.1 time: 0.157795 Jul 12 07:20:14.300631 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 414/838] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:14 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:15.317894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aa76bb5d-95cc-4028-bce7-71f1fedebae4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:15.318510 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aa76bb5d-95cc-4028-bce7-71f1fedebae4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:15.325491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa76bb5d-95cc-4028-bce7-71f1fedebae4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:15.325904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa76bb5d-95cc-4028-bce7-71f1fedebae4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:15.326658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa76bb5d-95cc-4028-bce7-71f1fedebae4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:15.327088 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa76bb5d-95cc-4028-bce7-71f1fedebae4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:15.462058 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aa76bb5d-95cc-4028-bce7-71f1fedebae4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:15.469987 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aa76bb5d-95cc-4028-bce7-71f1fedebae4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1319 microversion: 2.1 time: 0.156591 Jul 12 07:20:15.470562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 425/839] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:15 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:16.496131 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-81a73dd1-c128-480b-b45b-de3eaada162f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:16.498758 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-81a73dd1-c128-480b-b45b-de3eaada162f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:16.508327 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-81a73dd1-c128-480b-b45b-de3eaada162f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:16.508758 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-81a73dd1-c128-480b-b45b-de3eaada162f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:16.509567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-81a73dd1-c128-480b-b45b-de3eaada162f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:16.510003 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-81a73dd1-c128-480b-b45b-de3eaada162f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:16.654814 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-81a73dd1-c128-480b-b45b-de3eaada162f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:16.662779 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-81a73dd1-c128-480b-b45b-de3eaada162f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1319 microversion: 2.1 time: 0.176130 Jul 12 07:20:16.663354 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 415/840] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:16 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:17.680426 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5c9d1aa5-13eb-4ce3-a9ef-7c700174f8aa tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:17.680984 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5c9d1aa5-13eb-4ce3-a9ef-7c700174f8aa tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:17.690505 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c9d1aa5-13eb-4ce3-a9ef-7c700174f8aa tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:17.690946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c9d1aa5-13eb-4ce3-a9ef-7c700174f8aa tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:17.691693 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c9d1aa5-13eb-4ce3-a9ef-7c700174f8aa tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:17.692123 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c9d1aa5-13eb-4ce3-a9ef-7c700174f8aa tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:17.831210 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5c9d1aa5-13eb-4ce3-a9ef-7c700174f8aa tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:17.838778 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5c9d1aa5-13eb-4ce3-a9ef-7c700174f8aa tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1319 microversion: 2.1 time: 0.162369 Jul 12 07:20:17.839343 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 426/841] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:17 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:18.188601 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-605fd514-caab-4a9f-baa8-0bc96da697a7 req-84f5b957-9acb-488c-b38a-fd555ccf1f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5494aff2-8e9a-4813-b65a-ff9c39f056a6", "name": "network-vif-plugged", "status": "completed", "tag": "1f83cf7e-e488-47bb-99f5-cd1a1226c55c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:18.198100 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-605fd514-caab-4a9f-baa8-0bc96da697a7 req-84f5b957-9acb-488c-b38a-fd555ccf1f61 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:18.198517 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-605fd514-caab-4a9f-baa8-0bc96da697a7 req-84f5b957-9acb-488c-b38a-fd555ccf1f61 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:18.211405 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-605fd514-caab-4a9f-baa8-0bc96da697a7 req-84f5b957-9acb-488c-b38a-fd555ccf1f61 service nova] Creating event network-vif-plugged:1f83cf7e-e488-47bb-99f5-cd1a1226c55c for instance 5494aff2-8e9a-4813-b65a-ff9c39f056a6 on hv-cinder-82549 Jul 12 07:20:18.217713 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-605fd514-caab-4a9f-baa8-0bc96da697a7 req-84f5b957-9acb-488c-b38a-fd555ccf1f61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 Jul 12 07:20:18.218474 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 416/842] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:18.856202 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-46fd1d1e-1a31-4d8f-af34-40becba4322a tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:18.856864 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-46fd1d1e-1a31-4d8f-af34-40becba4322a tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:18.863090 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46fd1d1e-1a31-4d8f-af34-40becba4322a tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:18.863536 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46fd1d1e-1a31-4d8f-af34-40becba4322a tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:18.864294 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46fd1d1e-1a31-4d8f-af34-40becba4322a tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:18.864724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46fd1d1e-1a31-4d8f-af34-40becba4322a tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:19.074438 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-46fd1d1e-1a31-4d8f-af34-40becba4322a tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:19.082183 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-46fd1d1e-1a31-4d8f-af34-40becba4322a tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1319 microversion: 2.1 time: 0.230109 Jul 12 07:20:19.082761 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 427/843] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:18 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:20.097464 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:20.099224 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:20.107088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7169d397-fa00-4d40-8861-53f58344d405 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:20.107841 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7169d397-fa00-4d40-8861-53f58344d405 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:20.116216 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7169d397-fa00-4d40-8861-53f58344d405 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:20.116653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7169d397-fa00-4d40-8861-53f58344d405 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:20.117441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7169d397-fa00-4d40-8861-53f58344d405 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:20.117886 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7169d397-fa00-4d40-8861-53f58344d405 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:20.257848 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7169d397-fa00-4d40-8861-53f58344d405 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:20.265707 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7169d397-fa00-4d40-8861-53f58344d405 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1507 microversion: 2.1 time: 0.169686 Jul 12 07:20:20.266286 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 417/844] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:20 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:24.594639 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f4164749-004c-48a8-ae84-62ef0335fa8f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:24.595186 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f4164749-004c-48a8-ae84-62ef0335fa8f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:24.596259 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-2288848d-830b-47a4-8d13-59183225eec9 req-fbf640bf-725c-4cb9-afd1-1230f11496cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7ccb04-eb99-4561-9c24-4480c4e0422e", "tag": "696d296b-c149-42d6-896a-50d0d9cc8ad8"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:24.600629 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:24.603070 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4164749-004c-48a8-ae84-62ef0335fa8f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:24.603831 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4164749-004c-48a8-ae84-62ef0335fa8f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:24.604859 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4164749-004c-48a8-ae84-62ef0335fa8f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:24.605740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4164749-004c-48a8-ae84-62ef0335fa8f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:24.606074 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2288848d-830b-47a4-8d13-59183225eec9 req-fbf640bf-725c-4cb9-afd1-1230f11496cd service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:24.606947 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-2288848d-830b-47a4-8d13-59183225eec9 req-fbf640bf-725c-4cb9-afd1-1230f11496cd service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:24.618470 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-2288848d-830b-47a4-8d13-59183225eec9 req-fbf640bf-725c-4cb9-afd1-1230f11496cd service nova] Creating event network-changed:696d296b-c149-42d6-896a-50d0d9cc8ad8 for instance cf7ccb04-eb99-4561-9c24-4480c4e0422e on hv-cinder-82549 Jul 12 07:20:24.624676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-2288848d-830b-47a4-8d13-59183225eec9 req-fbf640bf-725c-4cb9-afd1-1230f11496cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032022 Jul 12 07:20:24.626018 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 418/845] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:24.636741 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f4164749-004c-48a8-ae84-62ef0335fa8f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:20:24.724658 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f4164749-004c-48a8-ae84-62ef0335fa8f tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 204 len: 0 microversion: 2.1 time: 0.134506 Jul 12 07:20:24.726499 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 428/846] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:20:24 2022] DELETE /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:20:24.736147 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8c592149-3561-4201-8706-9406c3fa1a91 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:24.737084 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8c592149-3561-4201-8706-9406c3fa1a91 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:24.743616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c592149-3561-4201-8706-9406c3fa1a91 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:24.744140 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c592149-3561-4201-8706-9406c3fa1a91 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:24.744996 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c592149-3561-4201-8706-9406c3fa1a91 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:24.745525 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8c592149-3561-4201-8706-9406c3fa1a91 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:24.889094 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8c592149-3561-4201-8706-9406c3fa1a91 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:24.903165 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8c592149-3561-4201-8706-9406c3fa1a91 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.172366 Jul 12 07:20:24.913824 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 419/847] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:24 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:25.675580 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d5f00534-85e4-4bbe-8e5c-951ae288d4d4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:25.676141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d5f00534-85e4-4bbe-8e5c-951ae288d4d4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:25.683778 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5f00534-85e4-4bbe-8e5c-951ae288d4d4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:25.684604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5f00534-85e4-4bbe-8e5c-951ae288d4d4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:25.685849 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5f00534-85e4-4bbe-8e5c-951ae288d4d4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:25.686290 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5f00534-85e4-4bbe-8e5c-951ae288d4d4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:25.727157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d5f00534-85e4-4bbe-8e5c-951ae288d4d4 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066604 Jul 12 07:20:25.727791 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 429/848] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 12 07:20:25 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:25.844130 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-136c7054-d2aa-4d7b-96e2-514a51ff89ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:25.844969 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-136c7054-d2aa-4d7b-96e2-514a51ff89ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:25.860264 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-136c7054-d2aa-4d7b-96e2-514a51ff89ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:25.861534 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-136c7054-d2aa-4d7b-96e2-514a51ff89ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:25.862661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-136c7054-d2aa-4d7b-96e2-514a51ff89ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:25.863425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-136c7054-d2aa-4d7b-96e2-514a51ff89ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:25.886824 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:25.901970 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-136c7054-d2aa-4d7b-96e2-514a51ff89ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:20:25.922515 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-81ab26d4-f016-4533-84d6-d4153c325c01 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:25.923699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-81ab26d4-f016-4533-84d6-d4153c325c01 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:25.931282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81ab26d4-f016-4533-84d6-d4153c325c01 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:25.931994 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81ab26d4-f016-4533-84d6-d4153c325c01 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:25.932861 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81ab26d4-f016-4533-84d6-d4153c325c01 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:25.933737 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81ab26d4-f016-4533-84d6-d4153c325c01 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:26.056066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-136c7054-d2aa-4d7b-96e2-514a51ff89ea tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "DELETE /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 204 len: 0 microversion: 2.20 time: 0.217026 Jul 12 07:20:26.056885 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 420/849] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 12 07:20:25 2022] DELETE /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 07:20:26.068151 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:26.069092 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:26.078247 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:26.078771 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:26.079579 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:26.080424 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:26.223903 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-81ab26d4-f016-4533-84d6-d4153c325c01 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:26.234981 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-81ab26d4-f016-4533-84d6-d4153c325c01 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.316847 Jul 12 07:20:26.236546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 430/850] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:25 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:26.284993 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:26.297663 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:26.298713 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:26.299867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6d7ae49c-0cfc-4056-b887-19e154e5f045 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.236760 Jul 12 07:20:26.300469 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 421/851] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:20:26 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:20:27.257946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-46ef984a-3b3c-4851-a59f-1b76905e959c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:27.258613 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-46ef984a-3b3c-4851-a59f-1b76905e959c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:27.261035 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:27.267550 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46ef984a-3b3c-4851-a59f-1b76905e959c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:27.267996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46ef984a-3b3c-4851-a59f-1b76905e959c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:27.268829 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46ef984a-3b3c-4851-a59f-1b76905e959c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:27.269259 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46ef984a-3b3c-4851-a59f-1b76905e959c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:27.322168 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:27.323662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:27.330762 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:27.331483 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:27.332425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:27.332838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:27.478564 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-46ef984a-3b3c-4851-a59f-1b76905e959c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:27.486934 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-46ef984a-3b3c-4851-a59f-1b76905e959c tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1569 microversion: 2.1 time: 0.232980 Jul 12 07:20:27.487745 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 431/852] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:27 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:27.516733 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:27.527919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:27.530143 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:27.531338 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d186f39e-2b2d-49ec-b57a-d90cf25c20c2 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.213235 Jul 12 07:20:27.532421 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 422/853] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:20:27 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:20:28.509734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5d974cc5-ae7c-4b3a-9fbe-7050674ece6a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:28.510429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5d974cc5-ae7c-4b3a-9fbe-7050674ece6a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:28.520916 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d974cc5-ae7c-4b3a-9fbe-7050674ece6a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:28.522007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d974cc5-ae7c-4b3a-9fbe-7050674ece6a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:28.522783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d974cc5-ae7c-4b3a-9fbe-7050674ece6a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:28.523238 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d974cc5-ae7c-4b3a-9fbe-7050674ece6a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:28.553704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:28.556487 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:28.570334 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:28.571331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:28.573366 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:28.574634 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:28.711867 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5d974cc5-ae7c-4b3a-9fbe-7050674ece6a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:28.723562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5d974cc5-ae7c-4b3a-9fbe-7050674ece6a tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1501 microversion: 2.1 time: 0.220923 Jul 12 07:20:28.725158 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 432/854] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:28 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:28.730429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-61a53981-1f9e-4a0e-a195-2bebaa0c7974 req-79a820cb-f23c-4a30-9a50-62257aff45a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7ccb04-eb99-4561-9c24-4480c4e0422e", "name": "network-vif-deleted", "tag": "696d296b-c149-42d6-896a-50d0d9cc8ad8"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:28.760477 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-61a53981-1f9e-4a0e-a195-2bebaa0c7974 req-79a820cb-f23c-4a30-9a50-62257aff45a2 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:28.761095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-61a53981-1f9e-4a0e-a195-2bebaa0c7974 req-79a820cb-f23c-4a30-9a50-62257aff45a2 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:28.774502 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-61a53981-1f9e-4a0e-a195-2bebaa0c7974 req-79a820cb-f23c-4a30-9a50-62257aff45a2 service nova] Creating event network-vif-deleted:696d296b-c149-42d6-896a-50d0d9cc8ad8 for instance cf7ccb04-eb99-4561-9c24-4480c4e0422e on hv-cinder-82549 Jul 12 07:20:28.781218 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-61a53981-1f9e-4a0e-a195-2bebaa0c7974 req-79a820cb-f23c-4a30-9a50-62257aff45a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054465 Jul 12 07:20:28.781899 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 433/855] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:28.846471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:28.858887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:28.859835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:28.861194 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7400900d-1318-41ff-9ed1-8293e5af484e tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1726 microversion: 2.20 time: 0.313316 Jul 12 07:20:28.862061 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 423/856] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:20:28 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1726 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 07:20:29.282104 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-39da2767-c646-44fa-a729-9008710f1da4 req-5bb7ac1f-128d-43bc-8388-193af1cd1d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8a7f04-501d-4547-b7ca-9e19f7d59c32", "name": "network-vif-deleted", "tag": "3564b5da-8b1e-491d-b0b1-502090eeb718"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:29.292139 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-39da2767-c646-44fa-a729-9008710f1da4 req-5bb7ac1f-128d-43bc-8388-193af1cd1d14 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:29.292503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-39da2767-c646-44fa-a729-9008710f1da4 req-5bb7ac1f-128d-43bc-8388-193af1cd1d14 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:29.329671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-39da2767-c646-44fa-a729-9008710f1da4 req-5bb7ac1f-128d-43bc-8388-193af1cd1d14 service nova] Creating event network-vif-deleted:3564b5da-8b1e-491d-b0b1-502090eeb718 for instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 on hv-cinder-82549 Jul 12 07:20:29.342059 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-39da2767-c646-44fa-a729-9008710f1da4 req-5bb7ac1f-128d-43bc-8388-193af1cd1d14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078583 Jul 12 07:20:29.343801 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 434/857] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:29.743480 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:29.744260 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:29.752034 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:29.752846 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:29.754252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:29.754739 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:29.790362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:29.790720 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:29.791391 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lazy-loading 'fault' on Instance uuid cf7ccb04-eb99-4561-9c24-4480c4e0422e {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:20:29.833655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516ee78e2f9c43b195ad64b7a1d68624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a2e6cc3cbd4691a33722b5d058e82b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:29.840653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dbd035a0-9149-4502-8cf3-bac980fea0db tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 200 len: 1178 microversion: 2.1 time: 0.101399 Jul 12 07:20:29.841491 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 424/858] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:29 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 1178 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:29.882765 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:29.883535 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:29.891044 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:29.891507 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:29.892257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:29.892681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:29.931376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:29.931824 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:29.932284 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lazy-loading 'fault' on Instance uuid db8a7f04-501d-4547-b7ca-9e19f7d59c32 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:20:29.979207 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:29.988928 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:29.990465 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53278c1c534344978ca40d7e2313c02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed408b23e4c48a5861e542d02e0ee64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:29.991625 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f3b57b73-93d2-4461-8e69-afb510caec21 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 200 len: 1372 microversion: 2.20 time: 0.113492 Jul 12 07:20:29.992145 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 435/859] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:20:29 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 07:20:30.859760 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:30.860490 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] [instance: cf7ccb04-eb99-4561-9c24-4480c4e0422e] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:30.868066 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:30.868894 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:30.869697 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:30.870283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:30.889496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] HTTP exception thrown: Instance cf7ccb04-eb99-4561-9c24-4480c4e0422e could not be found. Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Request method failure captured: Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e HTTP/1.1 Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR9g44hrtsdVbeRXYIAWQnMz4iLzNJ90c5fuqhSs2IuEiZmd0BX0-g2MWY9H_EdmQ8FbtMcm5DKUPAYQfEF3VUQhP_QWrDtOeDsK3IBeys8NrQonBZCIfNnp_BsHLDlEkFvv8irS5SjKnS1IIYBnDEbbY3CxRIe4cppRbTgqfLyzrRk Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 04a2e6cc3cbd4691a33722b5d058e82b Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-TestShelveInstance-1377424189 Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:20:30.891369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04a2e6cc3cbd4691a33722b5d058e82b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/04a2e6cc3cbd4691a33722b5d058e82b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_04a2e6cc3cbd4691a33722b5d058e82b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/04a2e6cc3cbd4691a33722b5d058e82b"}]}] Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-TestShelveInstance-1377424189 Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 04a2e6cc3cbd4691a33722b5d058e82b Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-TestShelveInstance-1377424189 Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-TestShelveInstance-1377424189-project Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 516ee78e2f9c43b195ad64b7a1d68624 Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-TestShelveInstance-1377424189-project Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance cf7ccb04-eb99-4561-9c24-4480c4e0422e could not be found. Jul 12 07:20:30.893157 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'cf7ccb04-eb99-4561-9c24-4480c4e0422e'} Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7ccb04-eb99-4561-9c24-4480c4e0422e could not be found. Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:30.894197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7ccb04-eb99-4561-9c24-4480c4e0422e could not be found. Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7ccb04-eb99-4561-9c24-4480c4e0422e could not be found. Jul 12 07:20:30.895591 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:30.896866 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Returning 404 to user: Instance cf7ccb04-eb99-4561-9c24-4480c4e0422e could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:30.896866 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b8bdba7e-1d40-4abe-b9c1-a6e2d82be6d6 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e" status: 404 len: 111 microversion: 2.1 time: 0.038048 Jul 12 07:20:30.896866 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 425/860] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:30 2022] GET /compute/v2.1/servers/cf7ccb04-eb99-4561-9c24-4480c4e0422e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:31.012417 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:31.014201 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:31.021129 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:31.022063 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:31.022983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:31.024199 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:31.040378 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] HTTP exception thrown: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Request method failure captured: Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 HTTP/1.1 Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8AEstPUYUAEPScrGy9oQr7FTt8tNmENsfWplBlyjF4vMNqpY7Z1frG3gEsDEzFRjm8e1X5VxAmYFZku4ZaZc-8o1Ij2GFrshboEUf5KCjQzbXNaIIzNWdO6k4-51-W_0wQWdQtFqjAFWDS7TRmNwbZguMpkEntiMBpDJcuh_D4hpU Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:31.042264 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ed408b23e4c48a5861e542d02e0ee64"}]}] Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 53278c1c534344978ca40d7e2313c02c Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:31.043773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'db8a7f04-501d-4547-b7ca-9e19f7d59c32'} Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:31.044614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:31.046234 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:31.047649 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Returning 404 to user: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:31.047649 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7dbe3986-9880-463d-80e7-bdb667cce2c7 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 404 len: 111 microversion: 2.20 time: 0.036628 Jul 12 07:20:31.053014 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0ffbb84e-f19a-4fab-bd05-db1a932f0631 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '.version_select at 0x7f7011615550>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:31.053403 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 436/861] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:20:31 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:20:31.081798 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0ffbb84e-f19a-4fab-bd05-db1a932f0631 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453589091" status: 204 len: 0 microversion: 2.20 time: 0.025440 Jul 12 07:20:31.081798 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 426/862] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 12 07:20:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453589091 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 12 07:20:31.160924 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8dc6af80-3e3d-40e9-aa18-db4d7b8fa289 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] Calling method '.version_select at 0x7f70116b33a0>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:31.198099 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8dc6af80-3e3d-40e9-aa18-db4d7b8fa289 tempest-TestShelveInstance-1377424189 tempest-TestShelveInstance-1377424189-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-866755811" status: 202 len: 0 microversion: 2.1 time: 0.045115 Jul 12 07:20:31.202841 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 437/863] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 07:20:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-866755811 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:20:33.631474 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:33.632655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:33.636711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:33.646898 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:33.647418 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:33.648262 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:33.648693 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:33.665699 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] HTTP exception thrown: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Request method failure captured: Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 HTTP/1.1 Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8AEstPUYUAEPScrGy9oQr7FTt8tNmENsfWplBlyjF4vMNqpY7Z1frG3gEsDEzFRjm8e1X5VxAmYFZku4ZaZc-8o1Ij2GFrshboEUf5KCjQzbXNaIIzNWdO6k4-51-W_0wQWdQtFqjAFWDS7TRmNwbZguMpkEntiMBpDJcuh_D4hpU Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:20:33.667467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ed408b23e4c48a5861e542d02e0ee64"}]}] Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 53278c1c534344978ca40d7e2313c02c Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.669023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'db8a7f04-501d-4547-b7ca-9e19f7d59c32'} Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:33.669870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.671087 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.672374 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Returning 404 to user: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:33.672374 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b405bdaa-bb77-4d5c-a1d9-63649340d624 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "DELETE /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 404 len: 111 microversion: 2.20 time: 0.042440 Jul 12 07:20:33.672374 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 427/864] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 12 07:20:33 2022] DELETE /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:20:33.679128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:33.679902 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: db8a7f04-501d-4547-b7ca-9e19f7d59c32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:33.689675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:33.691013 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:33.691821 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:33.692491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:33.708022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] HTTP exception thrown: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Request method failure captured: Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 HTTP/1.1 Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8AEstPUYUAEPScrGy9oQr7FTt8tNmENsfWplBlyjF4vMNqpY7Z1frG3gEsDEzFRjm8e1X5VxAmYFZku4ZaZc-8o1Ij2GFrshboEUf5KCjQzbXNaIIzNWdO6k4-51-W_0wQWdQtFqjAFWDS7TRmNwbZguMpkEntiMBpDJcuh_D4hpU Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:33.710004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ed408b23e4c48a5861e542d02e0ee64"}]}] Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 53278c1c534344978ca40d7e2313c02c Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.711656 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'db8a7f04-501d-4547-b7ca-9e19f7d59c32'} Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:33.712529 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. Jul 12 07:20:33.713905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:33.715928 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Returning 404 to user: Instance db8a7f04-501d-4547-b7ca-9e19f7d59c32 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:33.717013 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1499d0fd-38b5-40e0-8e5d-4030b315afbf tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32" status: 404 len: 111 microversion: 2.20 time: 0.043447 Jul 12 07:20:33.718571 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 438/865] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:20:33 2022] GET /compute/v2.1/servers/db8a7f04-501d-4547-b7ca-9e19f7d59c32 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:20:34.946004 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:34.948049 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:34.958707 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:34.959445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:34.960463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:34.961359 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:35.007601 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] HTTP exception thrown: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Request method failure captured: Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff HTTP/1.1 Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizR8AEstPUYUAEPScrGy9oQr7FTt8tNmENsfWplBlyjF4vMNqpY7Z1frG3gEsDEzFRjm8e1X5VxAmYFZku4ZaZc-8o1Ij2GFrshboEUf5KCjQzbXNaIIzNWdO6k4-51-W_0wQWdQtFqjAFWDS7TRmNwbZguMpkEntiMBpDJcuh_D4hpU Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:20:35.009276 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ed408b23e4c48a5861e542d02e0ee64"}]}] Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 53278c1c534344978ca40d7e2313c02c Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.010896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': 'e1dba59c-e816-486d-9296-9fcd6e5a51ff'} Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:35.011688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.013230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.017652 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Returning 404 to user: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:35.017652 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4d302803-dcfb-4ab7-9209-4d0824aab97d tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 404 len: 111 microversion: 2.20 time: 0.070616 Jul 12 07:20:35.017652 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 428/866] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 12 07:20:34 2022] DELETE /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:20:35.032119 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:35.032798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] [instance: e1dba59c-e816-486d-9296-9fcd6e5a51ff] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:35.045478 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:35.045964 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:35.050319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:35.050804 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:35.070829 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] HTTP exception thrown: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Request method failure captured: Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff HTTP/1.1 Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizR8AEstPUYUAEPScrGy9oQr7FTt8tNmENsfWplBlyjF4vMNqpY7Z1frG3gEsDEzFRjm8e1X5VxAmYFZku4ZaZc-8o1Ij2GFrshboEUf5KCjQzbXNaIIzNWdO6k4-51-W_0wQWdQtFqjAFWDS7TRmNwbZguMpkEntiMBpDJcuh_D4hpU Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:35.072416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2ed408b23e4c48a5861e542d02e0ee64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2ed408b23e4c48a5861e542d02e0ee64"}]}] Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 2ed408b23e4c48a5861e542d02e0ee64 Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1351445283 Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 53278c1c534344978ca40d7e2313c02c Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1351445283-project Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.073946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'e1dba59c-e816-486d-9296-9fcd6e5a51ff'} Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:35.074729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. Jul 12 07:20:35.077034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:35.081622 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] Returning 404 to user: Instance e1dba59c-e816-486d-9296-9fcd6e5a51ff could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:35.081622 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-30a34f19-c98a-4dd4-8c3f-7ce5b50bdc71 tempest-AttachVolumeShelveTestJSON-1351445283 tempest-AttachVolumeShelveTestJSON-1351445283-project] 10.222.0.25 "GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff" status: 404 len: 111 microversion: 2.20 time: 0.054447 Jul 12 07:20:35.081622 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 439/867] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 07:20:35 2022] GET /compute/v2.1/servers/e1dba59c-e816-486d-9296-9fcd6e5a51ff => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 07:20:42.182222 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b64ee53e-8107-4fdb-8c4a-94af9172669b tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feba1d30-7330-41c6-9a52-2756861ef953", "device": "/dev/sdb"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:42.184927 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b64ee53e-8107-4fdb-8c4a-94af9172669b tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:42.194134 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b64ee53e-8107-4fdb-8c4a-94af9172669b tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:42.195215 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b64ee53e-8107-4fdb-8c4a-94af9172669b tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:42.196386 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b64ee53e-8107-4fdb-8c4a-94af9172669b tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:42.197193 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b64ee53e-8107-4fdb-8c4a-94af9172669b tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:42.537611 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b64ee53e-8107-4fdb-8c4a-94af9172669b tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "POST /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359406 Jul 12 07:20:42.538555 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 429/868] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:20:42 2022] POST /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:43.297665 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5df06a78-b4e7-4643-9988-379c2e2a0702 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] Action: 'create', calling method: .version_select at 0x7f7011748790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1599607147", "metadata": {"Type": "work"}}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:43.632943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5df06a78-b4e7-4643-9988-379c2e2a0702 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.619692 Jul 12 07:20:43.634049 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 440/869] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 12 07:20:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 622 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 12 07:20:43.647832 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1bd18770-7043-44cf-ab1f-330b3c73a3d9 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] Calling method '.version_select at 0x7f701161a5e0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:43.732249 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1bd18770-7043-44cf-ab1f-330b3c73a3d9 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa" status: 200 len: 353 microversion: 2.1 time: 0.088996 Jul 12 07:20:43.733319 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 430/870] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:20:43 2022] GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:44.744798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-578ced44-2f85-40f2-89cf-6fc103df1638 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] Calling method '.version_select at 0x7f701168aa60>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:44.830241 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-578ced44-2f85-40f2-89cf-6fc103df1638 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa" status: 200 len: 354 microversion: 2.1 time: 0.089683 Jul 12 07:20:44.837074 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 441/871] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:20:44 2022] GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:44.847445 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4631147f-6ce6-46a3-9101-c26e657f62d7 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] Calling method '.version_select at 0x7f701163b040>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:44.914540 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4631147f-6ce6-46a3-9101-c26e657f62d7 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa" status: 200 len: 354 microversion: 2.1 time: 0.076174 Jul 12 07:20:44.915400 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 431/872] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:20:44 2022] GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:44.933244 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e0604e4f-954c-404c-a94d-cb61604380fd tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] Calling method '.version_select at 0x7f701168a820>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:45.027725 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e0604e4f-954c-404c-a94d-cb61604380fd tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa" status: 202 len: 0 microversion: 2.1 time: 0.098718 Jul 12 07:20:45.029098 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 442/873] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 07:20:44 2022] DELETE /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:20:45.037032 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9e6c22e8-cfd7-49c7-8f57-b6d3af377fc8 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] Calling method '.version_select at 0x7f7011615040>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:45.092910 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9e6c22e8-cfd7-49c7-8f57-b6d3af377fc8 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa" status: 200 len: 353 microversion: 2.1 time: 0.059847 Jul 12 07:20:45.093937 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 432/874] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:20:45 2022] GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:46.106906 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-25bd4b02-7baf-44e3-aeda-215a72a1c925 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] Calling method '.version_select at 0x7f7011727af0>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:46.119947 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:46.121186 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:46.159320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-25bd4b02-7baf-44e3-aeda-215a72a1c925 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] HTTP exception thrown: Volume dda2fed5-fc34-40ed-9782-f265d76acfaa could not be found. Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-25bd4b02-7baf-44e3-aeda-215a72a1c925 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] Request method failure captured: Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa HTTP/1.1 Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSDKzQapFUEtuleinAt2p9jtZYVICcT1jQnhJbj9MxP12w0K4qabfdeblfsGVoHtN-o4W_ApHM4gv5jACxfZVVJfNnZIroxE5Bw4N5uZPosYkbqqJ9urqYjdhqNYglNpZsib_i2Et8Ap6XaikMN5gx8KDaUdSXCSR0UVAwscXP773bU Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: f901e64bf5d8440e886b97f746573d95 Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesGetTestJSON-233855388 Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:20:46.161288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f901e64bf5d8440e886b97f746573d95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f901e64bf5d8440e886b97f746573d95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f901e64bf5d8440e886b97f746573d95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f901e64bf5d8440e886b97f746573d95"}]}] Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesGetTestJSON-233855388 Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: f901e64bf5d8440e886b97f746573d95 Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesGetTestJSON-233855388 Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesGetTestJSON-233855388-project Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 46249e04557249bfb9a9b68313131d4c Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesGetTestJSON-233855388-project Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Volume dda2fed5-fc34-40ed-9782-f265d76acfaa could not be found. Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'dda2fed5-fc34-40ed-9782-f265d76acfaa'} Jul 12 07:20:46.162764 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dda2fed5-fc34-40ed-9782-f265d76acfaa could not be found. (HTTP 404) (Request-ID: req-84b186dc-c460-4689-b6f2-94b806cce7f7) Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:46.163706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 07:20:46.165032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dda2fed5-fc34-40ed-9782-f265d76acfaa could not be found. Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 07:20:46.166273 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dda2fed5-fc34-40ed-9782-f265d76acfaa could not be found. Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dda2fed5-fc34-40ed-9782-f265d76acfaa could not be found. Jul 12 07:20:46.167601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:20:46.171690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-25bd4b02-7baf-44e3-aeda-215a72a1c925 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] Returning 404 to user: Volume dda2fed5-fc34-40ed-9782-f265d76acfaa could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:20:46.172543 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-25bd4b02-7baf-44e3-aeda-215a72a1c925 tempest-VolumesGetTestJSON-233855388 tempest-VolumesGetTestJSON-233855388-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa" status: 404 len: 109 microversion: 2.1 time: 0.070935 Jul 12 07:20:46.178904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 443/875] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 07:20:46 2022] GET /compute/v2.1/os-volumes/dda2fed5-fc34-40ed-9782-f265d76acfaa => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:20:47.547365 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1959222931", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "networks": [{"uuid": "7d3877bb-7ddc-468f-8eef-affd71b32145"}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:47.626176 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] validate_networks() for [('7d3877bb-7ddc-468f-8eef-affd71b32145', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:20:48.552805 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:20:48.553387 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:20:48.553833 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:20:48.554244 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:20:48.554643 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:20:48.573835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:48.574330 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:48.575503 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:48.576293 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:48.611125 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Getting quotas for project 3f78fe1ecaca42d2ae09999dcb3c8d7c. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:20:48.627662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Getting quotas for user 1aff23c6c4f6473eba8c6bc659345ba9 and project 3f78fe1ecaca42d2ae09999dcb3c8d7c. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:20:48.656383 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:20:48.659467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:20:48.762131 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fada83fa-abd1-4bc6-bf65-4e9193164cae tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221573 Jul 12 07:20:48.763663 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 433/876] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:20:48.776992 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b6c670b-b1e5-4eff-b6b6-46fa32b60f4c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:48.777702 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0b6c670b-b1e5-4eff-b6b6-46fa32b60f4c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:48.855657 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0b6c670b-b1e5-4eff-b6b6-46fa32b60f4c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:48.867136 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0b6c670b-b1e5-4eff-b6b6-46fa32b60f4c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1214 microversion: 2.1 time: 0.097450 Jul 12 07:20:48.868306 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 444/877] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:48 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:49.887364 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fc00c14c-03d0-494e-8325-ba0f3bda130f tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:49.889457 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fc00c14c-03d0-494e-8325-ba0f3bda130f tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:49.898980 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc00c14c-03d0-494e-8325-ba0f3bda130f tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:49.899419 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc00c14c-03d0-494e-8325-ba0f3bda130f tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:49.900567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc00c14c-03d0-494e-8325-ba0f3bda130f tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:49.901370 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc00c14c-03d0-494e-8325-ba0f3bda130f tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:50.012903 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fc00c14c-03d0-494e-8325-ba0f3bda130f tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:50.025537 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fc00c14c-03d0-494e-8325-ba0f3bda130f tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1266 microversion: 2.1 time: 0.143429 Jul 12 07:20:50.029137 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 434/878] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:49 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:51.046453 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0f5f5a03-2b38-4827-b474-c6100e78cd38 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:51.047059 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f5f5a03-2b38-4827-b474-c6100e78cd38 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:51.056422 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f5f5a03-2b38-4827-b474-c6100e78cd38 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:51.056849 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f5f5a03-2b38-4827-b474-c6100e78cd38 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:51.057667 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f5f5a03-2b38-4827-b474-c6100e78cd38 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:51.058090 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f5f5a03-2b38-4827-b474-c6100e78cd38 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:51.305852 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0f5f5a03-2b38-4827-b474-c6100e78cd38 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:51.316405 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0f5f5a03-2b38-4827-b474-c6100e78cd38 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1266 microversion: 2.1 time: 0.273986 Jul 12 07:20:51.319467 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 445/879] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:51 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:52.333576 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-35321778-f41b-47a4-8794-48729fd00094 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:52.334186 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-35321778-f41b-47a4-8794-48729fd00094 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:52.345712 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35321778-f41b-47a4-8794-48729fd00094 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:52.346147 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35321778-f41b-47a4-8794-48729fd00094 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:52.347096 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35321778-f41b-47a4-8794-48729fd00094 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:52.353971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-35321778-f41b-47a4-8794-48729fd00094 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:52.619778 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-35321778-f41b-47a4-8794-48729fd00094 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:52.631973 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-35321778-f41b-47a4-8794-48729fd00094 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1266 microversion: 2.1 time: 0.301476 Jul 12 07:20:52.649429 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 435/880] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:52 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:53.667707 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2ac3e710-957d-4b6d-8f48-3432545ce6f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:53.668706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2ac3e710-957d-4b6d-8f48-3432545ce6f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:53.675029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ac3e710-957d-4b6d-8f48-3432545ce6f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:53.675460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ac3e710-957d-4b6d-8f48-3432545ce6f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:53.685323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ac3e710-957d-4b6d-8f48-3432545ce6f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:53.686060 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ac3e710-957d-4b6d-8f48-3432545ce6f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:53.834534 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2ac3e710-957d-4b6d-8f48-3432545ce6f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:53.843422 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2ac3e710-957d-4b6d-8f48-3432545ce6f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1272 microversion: 2.1 time: 0.179485 Jul 12 07:20:53.846955 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 446/881] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:53 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:54.874507 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-08b63768-34f4-4351-b554-11817f619017 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:54.875112 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-08b63768-34f4-4351-b554-11817f619017 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:54.901517 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08b63768-34f4-4351-b554-11817f619017 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:54.901956 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08b63768-34f4-4351-b554-11817f619017 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:54.907131 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08b63768-34f4-4351-b554-11817f619017 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:54.914760 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08b63768-34f4-4351-b554-11817f619017 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:55.251290 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-08b63768-34f4-4351-b554-11817f619017 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:55.269685 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-08b63768-34f4-4351-b554-11817f619017 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.401437 Jul 12 07:20:55.270291 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 436/882] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:54 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:56.168336 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fdc1e50c-3960-447b-a0dc-a2b2f462299b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Action: 'create', calling method: .version_select at 0x7f7012b4af70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1485749986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Ry2bwpgJMi1DDetZBF2UbaBJI0whn/crQHgbAjNXp0Gk8XCF113a8IJHGuk7fefthF5bm9Axtko0gg6u86JcXQA4Jni8sKVaJaAxShqInyo8ELUjQDqlfuPgE9Gr52g=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:56.185024 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-fdc1e50c-3960-447b-a0dc-a2b2f462299b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Getting quotas for project 883812495f3940a3bdeff8d4c08a29c3. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:20:56.189805 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-fdc1e50c-3960-447b-a0dc-a2b2f462299b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Getting quotas for user 5279c7bf349746b4a4622f72945662ea and project 883812495f3940a3bdeff8d4c08a29c3. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:20:56.213759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fdc1e50c-3960-447b-a0dc-a2b2f462299b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.225300 Jul 12 07:20:56.214535 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 447/883] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:20:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:56.288260 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d8df4a08-797d-4dad-8c67-b79913a3fe6d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:56.288843 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d8df4a08-797d-4dad-8c67-b79913a3fe6d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:56.300528 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8df4a08-797d-4dad-8c67-b79913a3fe6d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:56.300968 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8df4a08-797d-4dad-8c67-b79913a3fe6d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:56.302420 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8df4a08-797d-4dad-8c67-b79913a3fe6d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:56.303358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8df4a08-797d-4dad-8c67-b79913a3fe6d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:56.310321 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:56.475698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d8df4a08-797d-4dad-8c67-b79913a3fe6d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:56.484262 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d8df4a08-797d-4dad-8c67-b79913a3fe6d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.200502 Jul 12 07:20:56.484754 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 437/884] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:56 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:57.503506 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e7ea28fb-c6f0-4623-84fc-81469bace8a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:57.504925 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e7ea28fb-c6f0-4623-84fc-81469bace8a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:57.514507 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7ea28fb-c6f0-4623-84fc-81469bace8a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:57.515765 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7ea28fb-c6f0-4623-84fc-81469bace8a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:57.516952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7ea28fb-c6f0-4623-84fc-81469bace8a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:57.517887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7ea28fb-c6f0-4623-84fc-81469bace8a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:57.748752 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7ea28fb-c6f0-4623-84fc-81469bace8a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:57.768058 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e7ea28fb-c6f0-4623-84fc-81469bace8a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.269131 Jul 12 07:20:57.769902 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 448/885] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:57 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:58.103137 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-5cc4b8da-a9eb-44f0-9d58-82342445f308 req-f14a7099-bcb2-473b-80ce-9fc6bd262da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2640f45f-df6e-4093-9880-eb8534ae1ceb", "tag": "10a09027-d165-4b38-932f-01131a97f71a"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:20:58.113675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5cc4b8da-a9eb-44f0-9d58-82342445f308 req-f14a7099-bcb2-473b-80ce-9fc6bd262da6 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:58.114457 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5cc4b8da-a9eb-44f0-9d58-82342445f308 req-f14a7099-bcb2-473b-80ce-9fc6bd262da6 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:58.130896 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-5cc4b8da-a9eb-44f0-9d58-82342445f308 req-f14a7099-bcb2-473b-80ce-9fc6bd262da6 service nova] Creating event network-changed:10a09027-d165-4b38-932f-01131a97f71a for instance 2640f45f-df6e-4093-9880-eb8534ae1ceb on hv-cinder-82549 Jul 12 07:20:58.136448 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-5cc4b8da-a9eb-44f0-9d58-82342445f308 req-f14a7099-bcb2-473b-80ce-9fc6bd262da6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037015 Jul 12 07:20:58.138110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 438/886] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:20:58.785149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cc452d66-4afb-4f9c-8c32-f0fa1f0b813d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:58.786442 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cc452d66-4afb-4f9c-8c32-f0fa1f0b813d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:58.793293 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cc452d66-4afb-4f9c-8c32-f0fa1f0b813d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:58.793597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cc452d66-4afb-4f9c-8c32-f0fa1f0b813d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:58.794564 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cc452d66-4afb-4f9c-8c32-f0fa1f0b813d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:58.794976 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cc452d66-4afb-4f9c-8c32-f0fa1f0b813d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:58.941787 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cc452d66-4afb-4f9c-8c32-f0fa1f0b813d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:20:58.949455 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cc452d66-4afb-4f9c-8c32-f0fa1f0b813d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.168270 Jul 12 07:20:58.950117 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 449/887] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:58 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:20:59.964075 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:59.964876 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:59.971779 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8b38bab7-22bf-4a48-bc05-9a46f6953398 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:20:59.972602 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8b38bab7-22bf-4a48-bc05-9a46f6953398 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:20:59.980838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b38bab7-22bf-4a48-bc05-9a46f6953398 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:59.981335 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b38bab7-22bf-4a48-bc05-9a46f6953398 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:20:59.982201 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b38bab7-22bf-4a48-bc05-9a46f6953398 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:20:59.982837 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b38bab7-22bf-4a48-bc05-9a46f6953398 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:00.126199 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8b38bab7-22bf-4a48-bc05-9a46f6953398 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:00.133708 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8b38bab7-22bf-4a48-bc05-9a46f6953398 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.170561 Jul 12 07:21:00.134258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 439/888] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:20:59 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:01.150427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-495f21a5-75c9-44ed-9496-5418f4bc74ef tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:01.150999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-495f21a5-75c9-44ed-9496-5418f4bc74ef tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:01.158235 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-495f21a5-75c9-44ed-9496-5418f4bc74ef tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:01.158666 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-495f21a5-75c9-44ed-9496-5418f4bc74ef tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:01.159554 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-495f21a5-75c9-44ed-9496-5418f4bc74ef tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:01.160092 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-495f21a5-75c9-44ed-9496-5418f4bc74ef tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:01.293504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-495f21a5-75c9-44ed-9496-5418f4bc74ef tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:01.301391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-495f21a5-75c9-44ed-9496-5418f4bc74ef tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.154933 Jul 12 07:21:01.301898 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 450/889] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:01 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:02.318986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-200a208a-a2df-4aca-acdb-370e67b10253 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:02.319427 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-200a208a-a2df-4aca-acdb-370e67b10253 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:02.326304 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-200a208a-a2df-4aca-acdb-370e67b10253 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:02.326739 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-200a208a-a2df-4aca-acdb-370e67b10253 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:02.327552 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-200a208a-a2df-4aca-acdb-370e67b10253 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:02.328013 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-200a208a-a2df-4aca-acdb-370e67b10253 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:02.574817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-200a208a-a2df-4aca-acdb-370e67b10253 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:02.586582 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-200a208a-a2df-4aca-acdb-370e67b10253 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.271082 Jul 12 07:21:02.587496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 440/890] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:02 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:03.603758 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cbe93f02-6754-4c5c-aea1-1af62815788c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:03.604301 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cbe93f02-6754-4c5c-aea1-1af62815788c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:03.611283 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbe93f02-6754-4c5c-aea1-1af62815788c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:03.611720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbe93f02-6754-4c5c-aea1-1af62815788c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:03.612471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbe93f02-6754-4c5c-aea1-1af62815788c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:03.612898 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbe93f02-6754-4c5c-aea1-1af62815788c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:03.749633 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cbe93f02-6754-4c5c-aea1-1af62815788c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:03.758602 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cbe93f02-6754-4c5c-aea1-1af62815788c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.158653 Jul 12 07:21:03.759186 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 451/891] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:03 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:04.778947 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ebb7d8e7-a79b-42b7-8f80-8a2fea3f3b88 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:04.779538 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ebb7d8e7-a79b-42b7-8f80-8a2fea3f3b88 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:04.786327 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ebb7d8e7-a79b-42b7-8f80-8a2fea3f3b88 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:04.786887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ebb7d8e7-a79b-42b7-8f80-8a2fea3f3b88 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:04.787732 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ebb7d8e7-a79b-42b7-8f80-8a2fea3f3b88 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:04.788229 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ebb7d8e7-a79b-42b7-8f80-8a2fea3f3b88 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:04.941379 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ebb7d8e7-a79b-42b7-8f80-8a2fea3f3b88 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:04.949766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ebb7d8e7-a79b-42b7-8f80-8a2fea3f3b88 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.176327 Jul 12 07:21:04.950568 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 441/892] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:04 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:05.967555 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1ae1d1ed-3062-4003-a694-645b0358d072 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:05.968406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1ae1d1ed-3062-4003-a694-645b0358d072 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:05.975284 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ae1d1ed-3062-4003-a694-645b0358d072 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:05.975728 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ae1d1ed-3062-4003-a694-645b0358d072 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:05.976514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ae1d1ed-3062-4003-a694-645b0358d072 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:05.976944 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ae1d1ed-3062-4003-a694-645b0358d072 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:06.116989 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1ae1d1ed-3062-4003-a694-645b0358d072 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:06.124843 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1ae1d1ed-3062-4003-a694-645b0358d072 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.161282 Jul 12 07:21:06.125447 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 452/893] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:05 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:06.211835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7532e652-2673-4bdf-8512-52c5022344f7 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:06.212362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7532e652-2673-4bdf-8512-52c5022344f7 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:06.214651 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:06.220315 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7532e652-2673-4bdf-8512-52c5022344f7 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:06.220758 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7532e652-2673-4bdf-8512-52c5022344f7 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:06.221549 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7532e652-2673-4bdf-8512-52c5022344f7 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:06.221972 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7532e652-2673-4bdf-8512-52c5022344f7 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:06.305883 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-7532e652-2673-4bdf-8512-52c5022344f7 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lazy-loading 'services' on Instance uuid 5494aff2-8e9a-4813-b65a-ff9c39f056a6 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:21:06.390636 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7532e652-2673-4bdf-8512-52c5022344f7 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6/os-volume_attachments/feba1d30-7330-41c6-9a52-2756861ef953" status: 202 len: 0 microversion: 2.1 time: 0.182567 Jul 12 07:21:06.391344 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 442/894] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:21:06 2022] DELETE /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6/os-volume_attachments/feba1d30-7330-41c6-9a52-2756861ef953 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:21:07.141621 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09490b65-cf66-43ae-9d94-eb2a61376c58 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:07.142226 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09490b65-cf66-43ae-9d94-eb2a61376c58 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:07.144114 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=6 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:07.150084 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09490b65-cf66-43ae-9d94-eb2a61376c58 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:07.150751 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09490b65-cf66-43ae-9d94-eb2a61376c58 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:07.151498 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09490b65-cf66-43ae-9d94-eb2a61376c58 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:07.151936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09490b65-cf66-43ae-9d94-eb2a61376c58 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:07.300693 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-09490b65-cf66-43ae-9d94-eb2a61376c58 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:07.318829 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09490b65-cf66-43ae-9d94-eb2a61376c58 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.180548 Jul 12 07:21:07.319734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 453/895] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:07 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:07.461878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-286cbc86-9bfc-4618-9c06-c38c35796ac2 req-91d60d14-eaa8-4006-ba4c-6fc1ae0e6a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2640f45f-df6e-4093-9880-eb8534ae1ceb", "name": "network-vif-plugged", "status": "completed", "tag": "10a09027-d165-4b38-932f-01131a97f71a"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:07.471940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-286cbc86-9bfc-4618-9c06-c38c35796ac2 req-91d60d14-eaa8-4006-ba4c-6fc1ae0e6a1e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:07.472668 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-286cbc86-9bfc-4618-9c06-c38c35796ac2 req-91d60d14-eaa8-4006-ba4c-6fc1ae0e6a1e service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:07.484450 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-286cbc86-9bfc-4618-9c06-c38c35796ac2 req-91d60d14-eaa8-4006-ba4c-6fc1ae0e6a1e service nova] Creating event network-vif-plugged:10a09027-d165-4b38-932f-01131a97f71a for instance 2640f45f-df6e-4093-9880-eb8534ae1ceb on hv-cinder-82549 Jul 12 07:21:07.489710 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-286cbc86-9bfc-4618-9c06-c38c35796ac2 req-91d60d14-eaa8-4006-ba4c-6fc1ae0e6a1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032318 Jul 12 07:21:07.490331 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 443/896] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:07.526407 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-940fc84e-d9ee-4166-989b-a2c2ac9f5d80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:07.526906 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-940fc84e-d9ee-4166-989b-a2c2ac9f5d80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:07.533816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-940fc84e-d9ee-4166-989b-a2c2ac9f5d80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:07.534340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-940fc84e-d9ee-4166-989b-a2c2ac9f5d80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:07.535299 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-940fc84e-d9ee-4166-989b-a2c2ac9f5d80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:07.540278 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-940fc84e-d9ee-4166-989b-a2c2ac9f5d80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:07.567069 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-940fc84e-d9ee-4166-989b-a2c2ac9f5d80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:21:07.652419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-940fc84e-d9ee-4166-989b-a2c2ac9f5d80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 204 len: 0 microversion: 2.1 time: 0.129353 Jul 12 07:21:07.656424 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 454/897] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:21:07 2022] DELETE /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:21:07.662388 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b4d5a248-5826-475e-998a-337aa58d4c7d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:07.663102 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b4d5a248-5826-475e-998a-337aa58d4c7d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:07.669521 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b4d5a248-5826-475e-998a-337aa58d4c7d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:07.669953 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b4d5a248-5826-475e-998a-337aa58d4c7d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:07.670709 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b4d5a248-5826-475e-998a-337aa58d4c7d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:07.671130 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b4d5a248-5826-475e-998a-337aa58d4c7d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:07.815576 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b4d5a248-5826-475e-998a-337aa58d4c7d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:07.823226 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b4d5a248-5826-475e-998a-337aa58d4c7d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1513 microversion: 2.1 time: 0.165235 Jul 12 07:21:07.823803 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 444/898] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:07 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:08.336346 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2794b7f8-4783-475b-a5ec-ee45b35fb2ab tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:08.337077 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2794b7f8-4783-475b-a5ec-ee45b35fb2ab tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:08.343990 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2794b7f8-4783-475b-a5ec-ee45b35fb2ab tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:08.344428 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2794b7f8-4783-475b-a5ec-ee45b35fb2ab tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:08.345177 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2794b7f8-4783-475b-a5ec-ee45b35fb2ab tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:08.345636 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2794b7f8-4783-475b-a5ec-ee45b35fb2ab tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:08.491643 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2794b7f8-4783-475b-a5ec-ee45b35fb2ab tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:08.499388 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2794b7f8-4783-475b-a5ec-ee45b35fb2ab tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.167149 Jul 12 07:21:08.500131 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 455/899] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:08 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:08.841242 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-249db39f-9a9f-49d7-a3d3-5c9a6a4a4374 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:08.841996 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-249db39f-9a9f-49d7-a3d3-5c9a6a4a4374 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:08.848989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-249db39f-9a9f-49d7-a3d3-5c9a6a4a4374 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:08.849495 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-249db39f-9a9f-49d7-a3d3-5c9a6a4a4374 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:08.850283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-249db39f-9a9f-49d7-a3d3-5c9a6a4a4374 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:08.850712 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-249db39f-9a9f-49d7-a3d3-5c9a6a4a4374 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:09.017113 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-249db39f-9a9f-49d7-a3d3-5c9a6a4a4374 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:09.024804 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-249db39f-9a9f-49d7-a3d3-5c9a6a4a4374 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1513 microversion: 2.1 time: 0.187574 Jul 12 07:21:09.025324 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 445/900] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:08 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:09.515883 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f53a2ff9-e0e6-48a4-b0eb-96b815fef96d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:09.516476 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f53a2ff9-e0e6-48a4-b0eb-96b815fef96d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:09.527601 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f53a2ff9-e0e6-48a4-b0eb-96b815fef96d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:09.528198 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f53a2ff9-e0e6-48a4-b0eb-96b815fef96d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:09.528956 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f53a2ff9-e0e6-48a4-b0eb-96b815fef96d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:09.529485 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f53a2ff9-e0e6-48a4-b0eb-96b815fef96d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:09.664542 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f53a2ff9-e0e6-48a4-b0eb-96b815fef96d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:09.672103 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f53a2ff9-e0e6-48a4-b0eb-96b815fef96d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1314 microversion: 2.1 time: 0.160120 Jul 12 07:21:09.672674 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 456/901] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:09 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:10.043644 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5108013f-9334-4720-a857-f52191f0798d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:10.044835 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5108013f-9334-4720-a857-f52191f0798d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:10.052072 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5108013f-9334-4720-a857-f52191f0798d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:10.052514 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5108013f-9334-4720-a857-f52191f0798d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:10.053303 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5108013f-9334-4720-a857-f52191f0798d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:10.053729 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5108013f-9334-4720-a857-f52191f0798d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:10.354866 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-5108013f-9334-4720-a857-f52191f0798d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:10.363468 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5108013f-9334-4720-a857-f52191f0798d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1513 microversion: 2.1 time: 0.323583 Jul 12 07:21:10.364073 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 446/902] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:10 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1513 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:10.690151 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-436d88f3-bec6-4820-b4f0-064602cc9e01 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:10.691396 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-436d88f3-bec6-4820-b4f0-064602cc9e01 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:10.698684 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-436d88f3-bec6-4820-b4f0-064602cc9e01 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:10.699128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-436d88f3-bec6-4820-b4f0-064602cc9e01 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:10.700005 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-436d88f3-bec6-4820-b4f0-064602cc9e01 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:10.700797 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-436d88f3-bec6-4820-b4f0-064602cc9e01 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:10.904888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-1e430a5f-b50d-4ff5-9703-0e6beea8cd25 req-1b7d6b9b-ed7a-4bbb-a21d-9cb7618782e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5494aff2-8e9a-4813-b65a-ff9c39f056a6", "name": "network-vif-deleted", "tag": "1f83cf7e-e488-47bb-99f5-cd1a1226c55c"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:10.914741 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-1e430a5f-b50d-4ff5-9703-0e6beea8cd25 req-1b7d6b9b-ed7a-4bbb-a21d-9cb7618782e1 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:10.915328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-1e430a5f-b50d-4ff5-9703-0e6beea8cd25 req-1b7d6b9b-ed7a-4bbb-a21d-9cb7618782e1 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:10.917143 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-436d88f3-bec6-4820-b4f0-064602cc9e01 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:10.928959 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-436d88f3-bec6-4820-b4f0-064602cc9e01 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1496 microversion: 2.1 time: 0.243716 Jul 12 07:21:10.930906 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-1e430a5f-b50d-4ff5-9703-0e6beea8cd25 req-1b7d6b9b-ed7a-4bbb-a21d-9cb7618782e1 service nova] Creating event network-vif-deleted:1f83cf7e-e488-47bb-99f5-cd1a1226c55c for instance 5494aff2-8e9a-4813-b65a-ff9c39f056a6 on hv-cinder-82549 Jul 12 07:21:10.937139 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 457/903] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:10 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1496 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:10.946590 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-1e430a5f-b50d-4ff5-9703-0e6beea8cd25 req-1b7d6b9b-ed7a-4bbb-a21d-9cb7618782e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046263 Jul 12 07:21:10.947311 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 447/904] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:11.209818 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1223202116", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:11.260887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] validate_networks() for None {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:21:11.383747 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:11.385697 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:11.392364 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:11.392801 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:11.393603 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:11.394031 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:11.426113 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:11.426426 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:11.426872 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lazy-loading 'fault' on Instance uuid 5494aff2-8e9a-4813-b65a-ff9c39f056a6 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:21:11.501589 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:11.509088 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c513305d-d642-40ab-91c1-406ee7954d74 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1309 microversion: 2.1 time: 0.130087 Jul 12 07:21:11.509655 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 448/905] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:11 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1309 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:11.514251 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5e2dab9c-fcc5-4e91-848b-6fc7431817f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:11.514981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5e2dab9c-fcc5-4e91-848b-6fc7431817f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:11.521423 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e2dab9c-fcc5-4e91-848b-6fc7431817f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:11.521870 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e2dab9c-fcc5-4e91-848b-6fc7431817f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:11.522661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e2dab9c-fcc5-4e91-848b-6fc7431817f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:11.523081 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5e2dab9c-fcc5-4e91-848b-6fc7431817f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:11.551614 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5e2dab9c-fcc5-4e91-848b-6fc7431817f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:21:11.587284 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:21:11.587909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:21:11.588597 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:21:11.589091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:21:11.589560 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:21:11.602211 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:11.609171 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:11.612109 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:11.612827 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:11.645092 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Getting quotas for project 4ba27eb979944a96a89df10c7e0b6dca. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:21:11.652759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Getting quotas for user 06e149f2b896405d863c98530333392b and project 4ba27eb979944a96a89df10c7e0b6dca. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:21:11.655560 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5e2dab9c-fcc5-4e91-848b-6fc7431817f7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 204 len: 0 microversion: 2.1 time: 0.141489 Jul 12 07:21:11.656444 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 449/906] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:21:11 2022] DELETE /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:21:11.665640 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-19269e4f-5fa6-40f7-83fa-b4fac726432b tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:11.666479 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-19269e4f-5fa6-40f7-83fa-b4fac726432b tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:11.672123 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:21:11.672593 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-19269e4f-5fa6-40f7-83fa-b4fac726432b tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:11.673714 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-19269e4f-5fa6-40f7-83fa-b4fac726432b tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:11.674510 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-19269e4f-5fa6-40f7-83fa-b4fac726432b tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:11.674933 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-19269e4f-5fa6-40f7-83fa-b4fac726432b tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:11.677883 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:21:11.749220 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-192f42ce-6c63-48e2-8704-9dab0d5df912 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543150 Jul 12 07:21:11.753210 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 458/907] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:21:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:21:11.760352 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-186219f3-4139-4191-9fc6-d53c60d7501f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:11.761340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-186219f3-4139-4191-9fc6-d53c60d7501f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:12.043622 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-186219f3-4139-4191-9fc6-d53c60d7501f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:12.054066 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-186219f3-4139-4191-9fc6-d53c60d7501f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1215 microversion: 2.1 time: 0.297929 Jul 12 07:21:12.054849 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 459/908] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:11 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1215 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:12.105989 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-19269e4f-5fa6-40f7-83fa-b4fac726432b tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:12.113833 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-19269e4f-5fa6-40f7-83fa-b4fac726432b tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1502 microversion: 2.1 time: 0.452441 Jul 12 07:21:12.114585 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 450/909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:11 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1502 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:12.529995 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:12.530589 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:12.538357 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:12.538870 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:12.539777 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:12.540276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:12.575753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:12.576193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:12.576627 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lazy-loading 'fault' on Instance uuid 5494aff2-8e9a-4813-b65a-ff9c39f056a6 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:21:12.620084 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:12.627919 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fbf04eae-1569-4f43-ab1e-28044e722b80 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 200 len: 1309 microversion: 2.1 time: 0.104272 Jul 12 07:21:12.628473 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 460/910] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:12 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:13.075807 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-6d04925b-0d34-47c2-a877-a41c61e439f5 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:13.076416 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-6d04925b-0d34-47c2-a877-a41c61e439f5 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:13.083389 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d04925b-0d34-47c2-a877-a41c61e439f5 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:13.083848 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d04925b-0d34-47c2-a877-a41c61e439f5 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:13.084608 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d04925b-0d34-47c2-a877-a41c61e439f5 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:13.085035 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-6d04925b-0d34-47c2-a877-a41c61e439f5 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:13.132954 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b2a39c6f-6af2-40e8-b7c3-29f05f7b5985 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:13.133991 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b2a39c6f-6af2-40e8-b7c3-29f05f7b5985 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:13.144176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2a39c6f-6af2-40e8-b7c3-29f05f7b5985 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:13.144176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2a39c6f-6af2-40e8-b7c3-29f05f7b5985 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:13.145259 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2a39c6f-6af2-40e8-b7c3-29f05f7b5985 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:13.145686 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2a39c6f-6af2-40e8-b7c3-29f05f7b5985 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:13.146626 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-6d04925b-0d34-47c2-a877-a41c61e439f5 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:13.154582 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-6d04925b-0d34-47c2-a877-a41c61e439f5 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1219 microversion: 2.1 time: 0.085258 Jul 12 07:21:13.155168 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 451/911] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:13 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:13.288257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b2a39c6f-6af2-40e8-b7c3-29f05f7b5985 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:13.296630 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b2a39c6f-6af2-40e8-b7c3-29f05f7b5985 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1502 microversion: 2.1 time: 0.168606 Jul 12 07:21:13.297476 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 461/912] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:13 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:13.645858 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:13.646565 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 5494aff2-8e9a-4813-b65a-ff9c39f056a6] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:13.654226 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:13.655080 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:13.655919 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:13.656413 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:13.675013 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] HTTP exception thrown: Instance 5494aff2-8e9a-4813-b65a-ff9c39f056a6 could not be found. Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Request method failure captured: Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 HTTP/1.1 Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizSCmJD6uHcKT6r403adKca_a6ojR_UbvBlbFUERG9ICpPih3hdAswHKjCUWUwjeIodry0msjmfpPkuwsMcnlGUO0B2GDl1tkPX4CH7a8JpENXcXuBUzUZo4h7Ft46FKMZloua1mH-PFRuO-JlkJQj7tfVnR9L41OVObMyyYkankHIMA Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: f15d014b88a444c28ae32f230d144e8c Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1130096577 Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:21:13.677547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f15d014b88a444c28ae32f230d144e8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f15d014b88a444c28ae32f230d144e8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f15d014b88a444c28ae32f230d144e8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f15d014b88a444c28ae32f230d144e8c"}]}] Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesSnapshotTestJSON-1130096577 Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: f15d014b88a444c28ae32f230d144e8c Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1130096577 Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesSnapshotTestJSON-1130096577-project Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 7e060034139f420e8412b8a55f1b29a2 Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesSnapshotTestJSON-1130096577-project Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 5494aff2-8e9a-4813-b65a-ff9c39f056a6 could not be found. Jul 12 07:21:13.679232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '5494aff2-8e9a-4813-b65a-ff9c39f056a6'} Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5494aff2-8e9a-4813-b65a-ff9c39f056a6 could not be found. Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:21:13.680362 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5494aff2-8e9a-4813-b65a-ff9c39f056a6 could not be found. Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5494aff2-8e9a-4813-b65a-ff9c39f056a6 could not be found. Jul 12 07:21:13.682859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:13.685476 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Returning 404 to user: Instance 5494aff2-8e9a-4813-b65a-ff9c39f056a6 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:21:13.686976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fa629f46-7cd0-4680-b9d8-f901f53cb656 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6" status: 404 len: 111 microversion: 2.1 time: 0.046312 Jul 12 07:21:13.687869 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 452/913] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:13 2022] GET /compute/v2.1/servers/5494aff2-8e9a-4813-b65a-ff9c39f056a6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:21:13.940445 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-7ea76016-f799-4fe1-9aa7-7e4f6c1d74dc req-dae1e0f3-6b04-4f93-b106-0a44c2e0b2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2640f45f-df6e-4093-9880-eb8534ae1ceb", "name": "network-vif-deleted", "tag": "10a09027-d165-4b38-932f-01131a97f71a"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:13.950491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-7ea76016-f799-4fe1-9aa7-7e4f6c1d74dc req-dae1e0f3-6b04-4f93-b106-0a44c2e0b2ca service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:13.951016 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-7ea76016-f799-4fe1-9aa7-7e4f6c1d74dc req-dae1e0f3-6b04-4f93-b106-0a44c2e0b2ca service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:13.955787 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:13.965868 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-7ea76016-f799-4fe1-9aa7-7e4f6c1d74dc req-dae1e0f3-6b04-4f93-b106-0a44c2e0b2ca service nova] Creating event network-vif-deleted:10a09027-d165-4b38-932f-01131a97f71a for instance 2640f45f-df6e-4093-9880-eb8534ae1ceb on hv-cinder-82549 Jul 12 07:21:13.972829 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-7ea76016-f799-4fe1-9aa7-7e4f6c1d74dc req-dae1e0f3-6b04-4f93-b106-0a44c2e0b2ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036660 Jul 12 07:21:13.973469 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 462/914] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:14.171606 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-badf862b-f40b-4e8e-ab79-11eaca6d5357 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:14.172173 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-badf862b-f40b-4e8e-ab79-11eaca6d5357 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:14.181888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-badf862b-f40b-4e8e-ab79-11eaca6d5357 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:14.182384 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-badf862b-f40b-4e8e-ab79-11eaca6d5357 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:14.183179 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-badf862b-f40b-4e8e-ab79-11eaca6d5357 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:14.183772 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-badf862b-f40b-4e8e-ab79-11eaca6d5357 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:14.256065 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-badf862b-f40b-4e8e-ab79-11eaca6d5357 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:14.258407 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:14.264931 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-badf862b-f40b-4e8e-ab79-11eaca6d5357 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1273 microversion: 2.1 time: 0.097316 Jul 12 07:21:14.265488 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 453/915] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:14 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:14.319475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:14.320603 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:14.330727 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:14.331170 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:14.331928 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:14.332357 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:14.363660 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:14.364095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:14.364531 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lazy-loading 'fault' on Instance uuid 2640f45f-df6e-4093-9880-eb8534ae1ceb {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:21:14.410964 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:14.418654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-76d8fc02-6958-4afa-a780-b3836bce0469 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1304 microversion: 2.1 time: 0.107523 Jul 12 07:21:14.419276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 463/916] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:14 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:15.287836 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2673a2e4-135e-49a6-ad9a-1b4aceb88154 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:15.288833 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2673a2e4-135e-49a6-ad9a-1b4aceb88154 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:15.298528 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2673a2e4-135e-49a6-ad9a-1b4aceb88154 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:15.298972 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2673a2e4-135e-49a6-ad9a-1b4aceb88154 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:15.299730 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2673a2e4-135e-49a6-ad9a-1b4aceb88154 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:15.300164 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2673a2e4-135e-49a6-ad9a-1b4aceb88154 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:15.362009 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2673a2e4-135e-49a6-ad9a-1b4aceb88154 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:15.369574 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2673a2e4-135e-49a6-ad9a-1b4aceb88154 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1273 microversion: 2.1 time: 0.089168 Jul 12 07:21:15.370129 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 454/917] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:15 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:15.438368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:15.438928 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:15.445873 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:15.446314 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:15.447065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:15.447491 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:15.478720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:15.479072 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:15.479510 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lazy-loading 'fault' on Instance uuid 2640f45f-df6e-4093-9880-eb8534ae1ceb {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:21:15.525919 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:15.533936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-63258d1a-1824-4105-bde1-d84af2a4a340 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1304 microversion: 2.1 time: 0.100575 Jul 12 07:21:15.534512 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 464/918] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:15 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:16.396031 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2d26802a-f68c-4622-bc7d-cf71620b9928 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:16.396931 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2d26802a-f68c-4622-bc7d-cf71620b9928 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:16.406729 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2d26802a-f68c-4622-bc7d-cf71620b9928 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:16.407167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2d26802a-f68c-4622-bc7d-cf71620b9928 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:16.407929 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2d26802a-f68c-4622-bc7d-cf71620b9928 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:16.408357 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2d26802a-f68c-4622-bc7d-cf71620b9928 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:16.471845 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2d26802a-f68c-4622-bc7d-cf71620b9928 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:16.479426 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2d26802a-f68c-4622-bc7d-cf71620b9928 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1273 microversion: 2.1 time: 0.090179 Jul 12 07:21:16.479993 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 455/919] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:16 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:16.555620 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:16.556618 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:16.560897 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:16.569755 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:16.570487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:16.571723 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:16.572438 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:16.605671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:16.606105 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:16.606544 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lazy-loading 'fault' on Instance uuid 2640f45f-df6e-4093-9880-eb8534ae1ceb {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:21:16.650358 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:16.662526 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-750429e7-b230-440d-8f0c-47f185a4f731 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 200 len: 1304 microversion: 2.1 time: 0.113308 Jul 12 07:21:16.663277 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 465/920] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:16 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:17.498425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-229757da-6614-495e-b66f-8358dbcd4f40 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:17.499404 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-229757da-6614-495e-b66f-8358dbcd4f40 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:17.507286 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-229757da-6614-495e-b66f-8358dbcd4f40 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:17.508133 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-229757da-6614-495e-b66f-8358dbcd4f40 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:17.509246 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-229757da-6614-495e-b66f-8358dbcd4f40 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:17.509831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-229757da-6614-495e-b66f-8358dbcd4f40 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:17.611519 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-229757da-6614-495e-b66f-8358dbcd4f40 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:17.630595 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-229757da-6614-495e-b66f-8358dbcd4f40 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1273 microversion: 2.1 time: 0.138097 Jul 12 07:21:17.633246 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 456/921] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:17 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:17.680182 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:17.680783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: 2640f45f-df6e-4093-9880-eb8534ae1ceb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:17.688784 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:17.689927 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:17.691638 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:17.692091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:17.708898 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] HTTP exception thrown: Instance 2640f45f-df6e-4093-9880-eb8534ae1ceb could not be found. Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Request method failure captured: Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb HTTP/1.1 Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSDNhG_BBJVNr16WwPgPKdPqFYyMwhg9Hnnj0z2_Afnw6X59nf6QpL8Jb8paa0_98GQ-tys3n9_qgE1kclURVAoNe4vYPAadF7FkwLHQShnv5rKKtd-oB91XTDmBKY0np5lvX-QIZjxVi9UDXw0woRudQcVrcGjjj11XtlRQNMSZvY4 Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 3f78fe1ecaca42d2ae09999dcb3c8d7c Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesActionsTest-1344863893 Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:21:17.711390 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f78fe1ecaca42d2ae09999dcb3c8d7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f78fe1ecaca42d2ae09999dcb3c8d7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f78fe1ecaca42d2ae09999dcb3c8d7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f78fe1ecaca42d2ae09999dcb3c8d7c"}]}] Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesActionsTest-1344863893 Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 3f78fe1ecaca42d2ae09999dcb3c8d7c Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesActionsTest-1344863893 Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesActionsTest-1344863893-project Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 1aff23c6c4f6473eba8c6bc659345ba9 Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesActionsTest-1344863893-project Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance 2640f45f-df6e-4093-9880-eb8534ae1ceb could not be found. Jul 12 07:21:17.713004 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '2640f45f-df6e-4093-9880-eb8534ae1ceb'} Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2640f45f-df6e-4093-9880-eb8534ae1ceb could not be found. Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:21:17.714176 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2640f45f-df6e-4093-9880-eb8534ae1ceb could not be found. Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2640f45f-df6e-4093-9880-eb8534ae1ceb could not be found. Jul 12 07:21:17.715951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:17.718496 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Returning 404 to user: Instance 2640f45f-df6e-4093-9880-eb8534ae1ceb could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:21:17.719492 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-be6390b1-daed-49f2-94a6-871873419da7 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb" status: 404 len: 111 microversion: 2.1 time: 0.043472 Jul 12 07:21:17.720355 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 466/922] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:17 2022] GET /compute/v2.1/servers/2640f45f-df6e-4093-9880-eb8534ae1ceb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:21:17.834079 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-4239537", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "networks": [{"uuid": "7d3877bb-7ddc-468f-8eef-affd71b32145"}]}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:17.885738 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.network.neutron [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] validate_networks() for [('7d3877bb-7ddc-468f-8eef-affd71b32145', None, None, None, None, None)] {{(pid=117998) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:21:18.560412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Flavor limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:21:18.561093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Image limits 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:21:18.561665 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Flavor pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:21:18.562119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Image pref 0:0:0 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:21:18.562589 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.virt.hardware [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117998) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:21:18.573183 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:18.573632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:18.574428 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:18.574864 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:18.592439 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Getting quotas for project 3f78fe1ecaca42d2ae09999dcb3c8d7c. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:21:18.596578 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Getting quotas for user 1aff23c6c4f6473eba8c6bc659345ba9 and project 3f78fe1ecaca42d2ae09999dcb3c8d7c. Resources: {'instances', 'ram', 'cores'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:21:18.607502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Going to run 1 instances... {{(pid=117998) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:21:18.609892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117998) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:21:18.650631 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-00c84c35-9e9c-4ad9-acf5-424a3c4e952f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:18.651476 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-00c84c35-9e9c-4ad9-acf5-424a3c4e952f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:18.660964 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00c84c35-9e9c-4ad9-acf5-424a3c4e952f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:18.661304 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dbfc9e69-1a97-4479-acb6-5d9a592a0f02 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831002 Jul 12 07:21:18.661750 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00c84c35-9e9c-4ad9-acf5-424a3c4e952f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:18.662254 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 457/923] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:21:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:21:18.667798 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00c84c35-9e9c-4ad9-acf5-424a3c4e952f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:18.668805 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00c84c35-9e9c-4ad9-acf5-424a3c4e952f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:18.672731 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2a5a4f02-2fd9-4ee8-919e-1abb220ed3eb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:18.673516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2a5a4f02-2fd9-4ee8-919e-1abb220ed3eb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:18.797535 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2a5a4f02-2fd9-4ee8-919e-1abb220ed3eb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:18.805900 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2a5a4f02-2fd9-4ee8-919e-1abb220ed3eb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1211 microversion: 2.1 time: 0.137924 Jul 12 07:21:18.806428 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 458/924] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:18 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1211 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:18.929112 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-00c84c35-9e9c-4ad9-acf5-424a3c4e952f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:18.940820 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-00c84c35-9e9c-4ad9-acf5-424a3c4e952f tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1315 microversion: 2.1 time: 0.294632 Jul 12 07:21:18.942034 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 467/925] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:18 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:19.088261 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-8a535724-53cb-4e28-a566-a9fe57c0b6c6 req-9fe50037-3cef-4da2-aea4-093282622372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb132a0-aee0-4923-b749-4e13397358cb", "tag": "d7ee7411-0658-481a-a2ac-6c89bbe93312"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:19.114537 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8a535724-53cb-4e28-a566-a9fe57c0b6c6 req-9fe50037-3cef-4da2-aea4-093282622372 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:19.115242 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8a535724-53cb-4e28-a566-a9fe57c0b6c6 req-9fe50037-3cef-4da2-aea4-093282622372 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:19.128699 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-8a535724-53cb-4e28-a566-a9fe57c0b6c6 req-9fe50037-3cef-4da2-aea4-093282622372 service nova] Creating event network-changed:d7ee7411-0658-481a-a2ac-6c89bbe93312 for instance 7eb132a0-aee0-4923-b749-4e13397358cb on hv-cinder-82549 Jul 12 07:21:19.134878 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-8a535724-53cb-4e28-a566-a9fe57c0b6c6 req-9fe50037-3cef-4da2-aea4-093282622372 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057423 Jul 12 07:21:19.135658 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 459/926] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:21:19.822884 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ac2a9b6f-6d2f-4f2d-8144-eae25898f5be tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:19.823486 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ac2a9b6f-6d2f-4f2d-8144-eae25898f5be tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:19.830871 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac2a9b6f-6d2f-4f2d-8144-eae25898f5be tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:19.831330 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac2a9b6f-6d2f-4f2d-8144-eae25898f5be tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:19.832214 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac2a9b6f-6d2f-4f2d-8144-eae25898f5be tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:19.832652 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac2a9b6f-6d2f-4f2d-8144-eae25898f5be tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:19.899578 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ac2a9b6f-6d2f-4f2d-8144-eae25898f5be tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:19.908059 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ac2a9b6f-6d2f-4f2d-8144-eae25898f5be tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1271 microversion: 2.1 time: 0.089104 Jul 12 07:21:19.908627 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 468/927] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:19 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:19.963167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ae2fcc3d-2438-479c-b60b-a814f1a7bd84 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:19.964246 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ae2fcc3d-2438-479c-b60b-a814f1a7bd84 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:19.971628 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ae2fcc3d-2438-479c-b60b-a814f1a7bd84 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:19.972077 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ae2fcc3d-2438-479c-b60b-a814f1a7bd84 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:19.972826 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ae2fcc3d-2438-479c-b60b-a814f1a7bd84 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:19.973303 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ae2fcc3d-2438-479c-b60b-a814f1a7bd84 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:20.112933 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ae2fcc3d-2438-479c-b60b-a814f1a7bd84 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:20.125158 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ae2fcc3d-2438-479c-b60b-a814f1a7bd84 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1315 microversion: 2.1 time: 0.169230 Jul 12 07:21:20.125749 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 460/928] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:19 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:20.929423 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-15b7b1cc-8ca4-4ba0-918c-bce0e4779931 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:20.930446 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-15b7b1cc-8ca4-4ba0-918c-bce0e4779931 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:20.939833 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15b7b1cc-8ca4-4ba0-918c-bce0e4779931 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:20.940269 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15b7b1cc-8ca4-4ba0-918c-bce0e4779931 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:20.941013 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15b7b1cc-8ca4-4ba0-918c-bce0e4779931 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:20.941477 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15b7b1cc-8ca4-4ba0-918c-bce0e4779931 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:21.010774 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-15b7b1cc-8ca4-4ba0-918c-bce0e4779931 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:21.018811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-15b7b1cc-8ca4-4ba0-918c-bce0e4779931 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1271 microversion: 2.1 time: 0.096092 Jul 12 07:21:21.019368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 469/929] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:20 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:21.147133 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-ae349ea3-d83f-4c0c-a418-a5d707362e81 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:21.148090 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-ae349ea3-d83f-4c0c-a418-a5d707362e81 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:21.160032 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ae349ea3-d83f-4c0c-a418-a5d707362e81 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:21.160764 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ae349ea3-d83f-4c0c-a418-a5d707362e81 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:21.162048 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ae349ea3-d83f-4c0c-a418-a5d707362e81 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:21.162761 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-ae349ea3-d83f-4c0c-a418-a5d707362e81 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:21.313669 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-ae349ea3-d83f-4c0c-a418-a5d707362e81 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:21.321450 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-ae349ea3-d83f-4c0c-a418-a5d707362e81 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1315 microversion: 2.1 time: 0.181184 Jul 12 07:21:21.322016 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 461/930] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:21 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:22.039132 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9304e5f-3917-4bbe-9ec5-6324e0fd63b9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:22.039779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d9304e5f-3917-4bbe-9ec5-6324e0fd63b9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:22.042379 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:22.049460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9304e5f-3917-4bbe-9ec5-6324e0fd63b9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:22.049897 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9304e5f-3917-4bbe-9ec5-6324e0fd63b9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:22.050645 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9304e5f-3917-4bbe-9ec5-6324e0fd63b9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:22.051071 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9304e5f-3917-4bbe-9ec5-6324e0fd63b9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:22.053807 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=8 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:22.120554 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d9304e5f-3917-4bbe-9ec5-6324e0fd63b9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:22.128439 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d9304e5f-3917-4bbe-9ec5-6324e0fd63b9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1271 microversion: 2.1 time: 0.095587 Jul 12 07:21:22.128963 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 470/931] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:22 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:22.341476 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-968138ed-09c5-4b1a-bbcf-b525389fcc22 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:22.342052 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-968138ed-09c5-4b1a-bbcf-b525389fcc22 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:22.349789 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-968138ed-09c5-4b1a-bbcf-b525389fcc22 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:22.350228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-968138ed-09c5-4b1a-bbcf-b525389fcc22 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:22.350975 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-968138ed-09c5-4b1a-bbcf-b525389fcc22 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:22.351399 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-968138ed-09c5-4b1a-bbcf-b525389fcc22 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:22.492065 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-968138ed-09c5-4b1a-bbcf-b525389fcc22 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:22.503698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-968138ed-09c5-4b1a-bbcf-b525389fcc22 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1315 microversion: 2.1 time: 0.168130 Jul 12 07:21:22.504519 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 462/932] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:22 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:23.149641 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6c7e853b-afd5-4786-a6d1-a8c692b9a1f9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:23.150645 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6c7e853b-afd5-4786-a6d1-a8c692b9a1f9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:23.160445 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c7e853b-afd5-4786-a6d1-a8c692b9a1f9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:23.160879 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c7e853b-afd5-4786-a6d1-a8c692b9a1f9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:23.161664 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c7e853b-afd5-4786-a6d1-a8c692b9a1f9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:23.162107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c7e853b-afd5-4786-a6d1-a8c692b9a1f9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:23.229191 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6c7e853b-afd5-4786-a6d1-a8c692b9a1f9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:23.237309 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6c7e853b-afd5-4786-a6d1-a8c692b9a1f9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1269 microversion: 2.1 time: 0.094218 Jul 12 07:21:23.237872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 471/933] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:23 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:23.525244 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-eba9a769-21c7-4a7b-925d-b0ad8be90bed tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:23.526168 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-eba9a769-21c7-4a7b-925d-b0ad8be90bed tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:23.537578 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eba9a769-21c7-4a7b-925d-b0ad8be90bed tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:23.538310 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eba9a769-21c7-4a7b-925d-b0ad8be90bed tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:23.539553 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eba9a769-21c7-4a7b-925d-b0ad8be90bed tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:23.540267 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-eba9a769-21c7-4a7b-925d-b0ad8be90bed tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:23.679308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-eba9a769-21c7-4a7b-925d-b0ad8be90bed tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:23.686887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-eba9a769-21c7-4a7b-925d-b0ad8be90bed tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1315 microversion: 2.1 time: 0.168218 Jul 12 07:21:23.687450 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 463/934] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:23 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:23.693607 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-929959160", "imageRef": "280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8", "flavorRef": "452", "networks": [{"uuid": "e4a6e019-8a65-4f37-835f-6edd447d396e"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:23.742729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] validate_networks() for [('e4a6e019-8a65-4f37-835f-6edd447d396e', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:21:24.256402 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3daadf11-e588-4fad-ae9c-3e23497e111c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:24.257902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3daadf11-e588-4fad-ae9c-3e23497e111c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:24.268228 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3daadf11-e588-4fad-ae9c-3e23497e111c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:24.269255 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3daadf11-e588-4fad-ae9c-3e23497e111c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:24.270414 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3daadf11-e588-4fad-ae9c-3e23497e111c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:24.272068 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3daadf11-e588-4fad-ae9c-3e23497e111c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:24.287673 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:21:24.288708 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:21:24.290011 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:21:24.290639 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:21:24.291268 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:21:24.310773 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:24.311292 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:24.312933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:24.313983 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:24.335738 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Getting quotas for project f15d014b88a444c28ae32f230d144e8c. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:21:24.340032 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Getting quotas for user 7e060034139f420e8412b8a55f1b29a2 and project f15d014b88a444c28ae32f230d144e8c. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:21:24.352145 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:21:24.354475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280ed4c9-b5f3-4bcc-ab2e-45851e2ae6a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:21:24.407517 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e3df0e24-bb51-4ebf-a66d-0f28885b31b0 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717542 Jul 12 07:21:24.411600 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 472/935] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:21:24.421784 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-53f9ed4d-ad80-47ca-a4d9-dc99a5b50c83 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:24.424421 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-53f9ed4d-ad80-47ca-a4d9-dc99a5b50c83 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:24.812877 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-53f9ed4d-ad80-47ca-a4d9-dc99a5b50c83 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:24.823271 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3daadf11-e588-4fad-ae9c-3e23497e111c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:24.829997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-53f9ed4d-ad80-47ca-a4d9-dc99a5b50c83 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1218 microversion: 2.1 time: 0.411930 Jul 12 07:21:24.845736 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3daadf11-e588-4fad-ae9c-3e23497e111c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1311 microversion: 2.1 time: 0.581786 Jul 12 07:21:24.845736 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 464/936] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:24 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1311 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:24.848233 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 473/937] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:24 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1218 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:24.855644 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c44d42d4-8fae-4c97-a4a4-59bd838da983 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:24.856348 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c44d42d4-8fae-4c97-a4a4-59bd838da983 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:24.859479 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-27440673", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1485749986", "security_groups": [{"name": "tempest-secgroup-smoke-1734143131"}], "block_device_mapping_v2": [{"uuid": "c7b4541d-c045-463d-aa2e-679e4cc0eb86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e1f0417e-f44e-4fb0-a137-3bcf769956d0"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:24.866783 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c44d42d4-8fae-4c97-a4a4-59bd838da983 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:24.875308 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c44d42d4-8fae-4c97-a4a4-59bd838da983 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:24.877267 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c44d42d4-8fae-4c97-a4a4-59bd838da983 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:24.879969 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c44d42d4-8fae-4c97-a4a4-59bd838da983 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:25.098192 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] validate_networks() for [('e1f0417e-f44e-4fb0-a137-3bcf769956d0', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:21:25.154063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c44d42d4-8fae-4c97-a4a4-59bd838da983 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:25.163381 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c44d42d4-8fae-4c97-a4a4-59bd838da983 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1315 microversion: 2.1 time: 0.326422 Jul 12 07:21:25.165204 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 465/938] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:24 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:25.172415 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-f93bea0e-75cd-4827-877a-6937c5ba8af1 req-c252b2bd-d486-4e27-b38d-021bce043d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d56d2c-4636-47ad-a4d1-45963993cddb", "tag": "1ddb0724-4b84-43f8-afba-2522dfbcbd94"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:25.182891 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-f93bea0e-75cd-4827-877a-6937c5ba8af1 req-c252b2bd-d486-4e27-b38d-021bce043d7a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:25.183689 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-f93bea0e-75cd-4827-877a-6937c5ba8af1 req-c252b2bd-d486-4e27-b38d-021bce043d7a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:25.199777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-f93bea0e-75cd-4827-877a-6937c5ba8af1 req-c252b2bd-d486-4e27-b38d-021bce043d7a service nova] Creating event network-changed:1ddb0724-4b84-43f8-afba-2522dfbcbd94 for instance d3d56d2c-4636-47ad-a4d1-45963993cddb on hv-cinder-82549 Jul 12 07:21:25.206020 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-f93bea0e-75cd-4827-877a-6937c5ba8af1 req-c252b2bd-d486-4e27-b38d-021bce043d7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038744 Jul 12 07:21:25.208594 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 466/939] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:25.519405 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:21:25.519973 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:21:25.520475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:21:25.520999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:21:25.521434 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:21:25.531515 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:25.532322 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:25.533538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:25.534151 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:25.554278 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Getting quotas for project 883812495f3940a3bdeff8d4c08a29c3. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:21:25.559024 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Getting quotas for user 5279c7bf349746b4a4622f72945662ea and project 883812495f3940a3bdeff8d4c08a29c3. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:21:25.628912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:21:25.631224 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7b4541d-c045-463d-aa2e-679e4cc0eb86',volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:21:25.789884 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-97c8a670-308e-44de-88a7-f39bcb2dc2d5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.935815 Jul 12 07:21:25.790821 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 474/940] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:21:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:21:25.802446 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7fe4f8c4-79ef-4083-bf43-4e2020249236 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:25.803239 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7fe4f8c4-79ef-4083-bf43-4e2020249236 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:25.853044 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-45f25bb9-f65a-4cde-a58e-a280b6d85b3a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:25.853044 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-45f25bb9-f65a-4cde-a58e-a280b6d85b3a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:25.878943 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45f25bb9-f65a-4cde-a58e-a280b6d85b3a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:25.882736 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7fe4f8c4-79ef-4083-bf43-4e2020249236 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:25.884331 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45f25bb9-f65a-4cde-a58e-a280b6d85b3a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:25.885173 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45f25bb9-f65a-4cde-a58e-a280b6d85b3a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:25.891895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45f25bb9-f65a-4cde-a58e-a280b6d85b3a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:25.892550 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7fe4f8c4-79ef-4083-bf43-4e2020249236 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1093 microversion: 2.1 time: 0.095113 Jul 12 07:21:25.893278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 467/941] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:25 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1093 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:25.906350 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1f2a87b2-4a1d-4d21-9c9f-edbdbf069dc4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:25.907609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1f2a87b2-4a1d-4d21-9c9f-edbdbf069dc4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:25.919825 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f2a87b2-4a1d-4d21-9c9f-edbdbf069dc4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:25.920272 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f2a87b2-4a1d-4d21-9c9f-edbdbf069dc4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:25.921097 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f2a87b2-4a1d-4d21-9c9f-edbdbf069dc4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:25.921502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1f2a87b2-4a1d-4d21-9c9f-edbdbf069dc4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:26.058279 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1f2a87b2-4a1d-4d21-9c9f-edbdbf069dc4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:26.068416 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1f2a87b2-4a1d-4d21-9c9f-edbdbf069dc4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1288 microversion: 2.1 time: 0.173864 Jul 12 07:21:26.069826 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 468/942] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:25 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1288 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:26.157015 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-45f25bb9-f65a-4cde-a58e-a280b6d85b3a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:26.165577 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-45f25bb9-f65a-4cde-a58e-a280b6d85b3a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1311 microversion: 2.1 time: 0.319891 Jul 12 07:21:26.166166 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 475/943] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:25 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1311 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:26.181924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e500d844-4c12-407c-92cb-d79a0807b8a4 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:26.182756 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e500d844-4c12-407c-92cb-d79a0807b8a4 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:26.188888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e500d844-4c12-407c-92cb-d79a0807b8a4 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:26.189376 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e500d844-4c12-407c-92cb-d79a0807b8a4 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:26.190131 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e500d844-4c12-407c-92cb-d79a0807b8a4 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:26.190567 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e500d844-4c12-407c-92cb-d79a0807b8a4 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:26.402751 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e500d844-4c12-407c-92cb-d79a0807b8a4 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:26.410941 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e500d844-4c12-407c-92cb-d79a0807b8a4 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1315 microversion: 2.1 time: 0.232953 Jul 12 07:21:26.411712 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 469/944] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:26 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:26.910900 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-282f58e4-32c2-4465-9894-5cfce67bc49e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:26.911490 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-282f58e4-32c2-4465-9894-5cfce67bc49e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:26.918287 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282f58e4-32c2-4465-9894-5cfce67bc49e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:26.918710 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282f58e4-32c2-4465-9894-5cfce67bc49e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:26.919788 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282f58e4-32c2-4465-9894-5cfce67bc49e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:26.920319 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282f58e4-32c2-4465-9894-5cfce67bc49e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:27.002750 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-282f58e4-32c2-4465-9894-5cfce67bc49e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:27.012772 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-282f58e4-32c2-4465-9894-5cfce67bc49e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1143 microversion: 2.1 time: 0.105737 Jul 12 07:21:27.013886 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 476/945] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:26 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1143 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:27.090775 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-12785a7b-8ce3-4991-b99a-0f30caf0a89d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:27.091401 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-12785a7b-8ce3-4991-b99a-0f30caf0a89d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:27.099076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-12785a7b-8ce3-4991-b99a-0f30caf0a89d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:27.099635 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-12785a7b-8ce3-4991-b99a-0f30caf0a89d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:27.100479 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-12785a7b-8ce3-4991-b99a-0f30caf0a89d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:27.100916 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-12785a7b-8ce3-4991-b99a-0f30caf0a89d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:27.183768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-91b125c9-4f35-41f1-8411-a567dd17db8d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:27.184381 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-91b125c9-4f35-41f1-8411-a567dd17db8d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:27.207307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91b125c9-4f35-41f1-8411-a567dd17db8d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:27.207707 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91b125c9-4f35-41f1-8411-a567dd17db8d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:27.208481 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91b125c9-4f35-41f1-8411-a567dd17db8d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:27.208912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91b125c9-4f35-41f1-8411-a567dd17db8d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:27.390773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-12785a7b-8ce3-4991-b99a-0f30caf0a89d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:27.400197 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-12785a7b-8ce3-4991-b99a-0f30caf0a89d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1318 microversion: 2.1 time: 0.316871 Jul 12 07:21:27.411316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 470/946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:27 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:27.431727 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-00910802-6f89-42e3-8b87-117fa67cacf1 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:27.432340 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-00910802-6f89-42e3-8b87-117fa67cacf1 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:27.440977 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00910802-6f89-42e3-8b87-117fa67cacf1 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:27.441454 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00910802-6f89-42e3-8b87-117fa67cacf1 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:27.442212 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00910802-6f89-42e3-8b87-117fa67cacf1 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:27.442844 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00910802-6f89-42e3-8b87-117fa67cacf1 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:27.517316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91b125c9-4f35-41f1-8411-a567dd17db8d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:27.525958 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-91b125c9-4f35-41f1-8411-a567dd17db8d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1311 microversion: 2.1 time: 0.346315 Jul 12 07:21:27.527277 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 477/947] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:27 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1311 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:27.563311 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-01441350-7faa-4bca-b150-9b9f510a32bb req-f104bfc5-4a47-4e99-a6dc-62d30eae5a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb132a0-aee0-4923-b749-4e13397358cb", "name": "network-vif-plugged", "status": "completed", "tag": "d7ee7411-0658-481a-a2ac-6c89bbe93312"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:27.575302 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-01441350-7faa-4bca-b150-9b9f510a32bb req-f104bfc5-4a47-4e99-a6dc-62d30eae5a76 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:27.575971 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-01441350-7faa-4bca-b150-9b9f510a32bb req-f104bfc5-4a47-4e99-a6dc-62d30eae5a76 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:27.590936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-01441350-7faa-4bca-b150-9b9f510a32bb req-f104bfc5-4a47-4e99-a6dc-62d30eae5a76 service nova] Creating event network-vif-plugged:d7ee7411-0658-481a-a2ac-6c89bbe93312 for instance 7eb132a0-aee0-4923-b749-4e13397358cb on hv-cinder-82549 Jul 12 07:21:27.614372 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-01441350-7faa-4bca-b150-9b9f510a32bb req-f104bfc5-4a47-4e99-a6dc-62d30eae5a76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055800 Jul 12 07:21:27.623964 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 478/948] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:21:27.751476 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-00910802-6f89-42e3-8b87-117fa67cacf1 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:27.759719 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-00910802-6f89-42e3-8b87-117fa67cacf1 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1315 microversion: 2.1 time: 0.334796 Jul 12 07:21:27.761089 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 471/949] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:27 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:28.033274 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c5338801-0786-4763-ba82-e07efca0f146 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:28.034545 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-7ed285a5-6ee8-49e0-a64b-0361802890f8 req-96f3958a-d259-438c-9623-5124a727046a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03413629-3056-435a-a80f-bddd5848a6c8", "tag": "c4e27f35-9d2e-4791-b805-d15308b97a37"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:28.035114 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c5338801-0786-4763-ba82-e07efca0f146 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:28.042838 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5338801-0786-4763-ba82-e07efca0f146 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:28.043753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5338801-0786-4763-ba82-e07efca0f146 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:28.045449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5338801-0786-4763-ba82-e07efca0f146 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:28.046105 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5338801-0786-4763-ba82-e07efca0f146 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:28.047030 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-7ed285a5-6ee8-49e0-a64b-0361802890f8 req-96f3958a-d259-438c-9623-5124a727046a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:28.049257 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-7ed285a5-6ee8-49e0-a64b-0361802890f8 req-96f3958a-d259-438c-9623-5124a727046a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:28.077381 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-7ed285a5-6ee8-49e0-a64b-0361802890f8 req-96f3958a-d259-438c-9623-5124a727046a service nova] Creating event network-changed:c4e27f35-9d2e-4791-b805-d15308b97a37 for instance 03413629-3056-435a-a80f-bddd5848a6c8 on hv-cinder-82549 Jul 12 07:21:28.090320 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-7ed285a5-6ee8-49e0-a64b-0361802890f8 req-96f3958a-d259-438c-9623-5124a727046a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059296 Jul 12 07:21:28.094292 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 472/950] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:28.201717 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c5338801-0786-4763-ba82-e07efca0f146 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:28.211392 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c5338801-0786-4763-ba82-e07efca0f146 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1209 microversion: 2.1 time: 0.183343 Jul 12 07:21:28.212439 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 479/951] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:28 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1209 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:28.420446 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-bf68f85e-1f10-453c-a2c6-0b22111e47e3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:28.421020 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-bf68f85e-1f10-453c-a2c6-0b22111e47e3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:28.427950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bf68f85e-1f10-453c-a2c6-0b22111e47e3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:28.428398 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bf68f85e-1f10-453c-a2c6-0b22111e47e3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:28.429245 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bf68f85e-1f10-453c-a2c6-0b22111e47e3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:28.429666 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-bf68f85e-1f10-453c-a2c6-0b22111e47e3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:28.545204 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-172ec097-3412-4ef2-b986-11142d2ca98a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:28.545813 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-172ec097-3412-4ef2-b986-11142d2ca98a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:28.552405 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-172ec097-3412-4ef2-b986-11142d2ca98a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:28.552839 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-172ec097-3412-4ef2-b986-11142d2ca98a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:28.553636 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-172ec097-3412-4ef2-b986-11142d2ca98a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:28.554061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-172ec097-3412-4ef2-b986-11142d2ca98a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:28.583001 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:28.705443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-bf68f85e-1f10-453c-a2c6-0b22111e47e3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:28.713328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-bf68f85e-1f10-453c-a2c6-0b22111e47e3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1318 microversion: 2.1 time: 0.297755 Jul 12 07:21:28.713893 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 473/952] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:28 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:28.778552 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3db1da2e-8079-49f3-89d9-dc6c45b5af28 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:28.779075 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3db1da2e-8079-49f3-89d9-dc6c45b5af28 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:28.785809 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3db1da2e-8079-49f3-89d9-dc6c45b5af28 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:28.786250 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3db1da2e-8079-49f3-89d9-dc6c45b5af28 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:28.787019 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3db1da2e-8079-49f3-89d9-dc6c45b5af28 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:28.787447 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3db1da2e-8079-49f3-89d9-dc6c45b5af28 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:28.806429 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-172ec097-3412-4ef2-b986-11142d2ca98a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:28.814530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-172ec097-3412-4ef2-b986-11142d2ca98a tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1311 microversion: 2.1 time: 0.273438 Jul 12 07:21:28.815311 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 480/953] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:28 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:29.052206 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3db1da2e-8079-49f3-89d9-dc6c45b5af28 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:29.061831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3db1da2e-8079-49f3-89d9-dc6c45b5af28 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1315 microversion: 2.1 time: 0.287492 Jul 12 07:21:29.069175 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 474/954] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:28 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:29.229247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78c4c189-f146-4046-98cd-ddf46d607728 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:29.229765 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78c4c189-f146-4046-98cd-ddf46d607728 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:29.236416 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78c4c189-f146-4046-98cd-ddf46d607728 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:29.236851 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78c4c189-f146-4046-98cd-ddf46d607728 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:29.237630 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78c4c189-f146-4046-98cd-ddf46d607728 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:29.238049 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78c4c189-f146-4046-98cd-ddf46d607728 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:29.543263 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78c4c189-f146-4046-98cd-ddf46d607728 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:29.551144 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78c4c189-f146-4046-98cd-ddf46d607728 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.325889 Jul 12 07:21:29.551952 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 481/955] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:29 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:29.731764 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c3fb7604-f203-479e-af61-f525be2dc1a6 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:29.732852 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c3fb7604-f203-479e-af61-f525be2dc1a6 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:29.739837 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3fb7604-f203-479e-af61-f525be2dc1a6 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:29.740350 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3fb7604-f203-479e-af61-f525be2dc1a6 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:29.741186 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3fb7604-f203-479e-af61-f525be2dc1a6 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:29.741810 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c3fb7604-f203-479e-af61-f525be2dc1a6 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:29.746305 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=100 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:29.838300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d6adc8e2-25f9-449f-b320-b313d6409693 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:29.841206 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d6adc8e2-25f9-449f-b320-b313d6409693 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:29.854217 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6adc8e2-25f9-449f-b320-b313d6409693 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:29.855359 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6adc8e2-25f9-449f-b320-b313d6409693 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:29.856763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6adc8e2-25f9-449f-b320-b313d6409693 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:29.857951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6adc8e2-25f9-449f-b320-b313d6409693 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:29.866312 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:30.000506 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c3fb7604-f203-479e-af61-f525be2dc1a6 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:30.010605 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c3fb7604-f203-479e-af61-f525be2dc1a6 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1318 microversion: 2.1 time: 0.283583 Jul 12 07:21:30.018453 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 475/956] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:29 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:30.079518 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fba32f74-c1ce-4e28-b1db-f133bed009dd tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:30.080098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fba32f74-c1ce-4e28-b1db-f133bed009dd tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:30.086665 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fba32f74-c1ce-4e28-b1db-f133bed009dd tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:30.086876 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fba32f74-c1ce-4e28-b1db-f133bed009dd tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:30.087475 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d6adc8e2-25f9-449f-b320-b313d6409693 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:30.087671 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fba32f74-c1ce-4e28-b1db-f133bed009dd tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:30.087976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fba32f74-c1ce-4e28-b1db-f133bed009dd tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:30.100197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d6adc8e2-25f9-449f-b320-b313d6409693 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1311 microversion: 2.1 time: 0.271709 Jul 12 07:21:30.101448 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 482/957] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:29 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:30.185307 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-b44847d8-e621-4a7b-bf8e-f272f72e7a97 req-3628da90-9900-44b0-84be-c6e166da8836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3776b5e2-d4ea-4709-9f38-44945b6ff3f3", "tag": "dfa4e3d1-b3f0-43a9-b856-0e0a60dc1a3e"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:30.193827 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b44847d8-e621-4a7b-bf8e-f272f72e7a97 req-3628da90-9900-44b0-84be-c6e166da8836 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:30.194272 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b44847d8-e621-4a7b-bf8e-f272f72e7a97 req-3628da90-9900-44b0-84be-c6e166da8836 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:30.208090 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-b44847d8-e621-4a7b-bf8e-f272f72e7a97 req-3628da90-9900-44b0-84be-c6e166da8836 service nova] Creating event network-changed:dfa4e3d1-b3f0-43a9-b856-0e0a60dc1a3e for instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 on hv-cinder-82549 Jul 12 07:21:30.212916 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-b44847d8-e621-4a7b-bf8e-f272f72e7a97 req-3628da90-9900-44b0-84be-c6e166da8836 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031368 Jul 12 07:21:30.213892 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 483/958] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:30.264931 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fba32f74-c1ce-4e28-b1db-f133bed009dd tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:30.273310 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fba32f74-c1ce-4e28-b1db-f133bed009dd tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1465 microversion: 2.1 time: 0.197756 Jul 12 07:21:30.273908 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 476/959] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:30 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1465 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:30.314663 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cfbd1a8c-1e09-424c-8c9b-3cd0ad7a498d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:30.315375 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cfbd1a8c-1e09-424c-8c9b-3cd0ad7a498d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:30.321864 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbd1a8c-1e09-424c-8c9b-3cd0ad7a498d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:30.322303 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbd1a8c-1e09-424c-8c9b-3cd0ad7a498d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:30.323058 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbd1a8c-1e09-424c-8c9b-3cd0ad7a498d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:30.323481 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbd1a8c-1e09-424c-8c9b-3cd0ad7a498d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:30.350436 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cfbd1a8c-1e09-424c-8c9b-3cd0ad7a498d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:21:30.429818 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cfbd1a8c-1e09-424c-8c9b-3cd0ad7a498d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 204 len: 0 microversion: 2.1 time: 0.119458 Jul 12 07:21:30.430342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 484/960] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:21:30 2022] DELETE /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:21:30.438810 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-897d1071-859b-41b0-8320-9d5367434f7d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:30.439415 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-897d1071-859b-41b0-8320-9d5367434f7d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:30.445543 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-897d1071-859b-41b0-8320-9d5367434f7d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:30.445985 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-897d1071-859b-41b0-8320-9d5367434f7d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:30.446738 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-897d1071-859b-41b0-8320-9d5367434f7d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:30.447167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-897d1071-859b-41b0-8320-9d5367434f7d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:30.569284 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08df6aad-3b48-4614-b39c-e341f80e9c56 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:30.569891 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08df6aad-3b48-4614-b39c-e341f80e9c56 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:30.576260 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08df6aad-3b48-4614-b39c-e341f80e9c56 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:30.576715 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08df6aad-3b48-4614-b39c-e341f80e9c56 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:30.577506 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08df6aad-3b48-4614-b39c-e341f80e9c56 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:30.577936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08df6aad-3b48-4614-b39c-e341f80e9c56 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:30.583392 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-897d1071-859b-41b0-8320-9d5367434f7d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:30.590800 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-897d1071-859b-41b0-8320-9d5367434f7d tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1471 microversion: 2.1 time: 0.156169 Jul 12 07:21:30.591375 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 477/961] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:30 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:30.711561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08df6aad-3b48-4614-b39c-e341f80e9c56 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:30.719419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08df6aad-3b48-4614-b39c-e341f80e9c56 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.154516 Jul 12 07:21:30.719988 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 485/962] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:30 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:31.028425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-43ca4383-5444-4d71-9618-f1d42363dfa4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:31.029004 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-43ca4383-5444-4d71-9618-f1d42363dfa4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:31.035964 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43ca4383-5444-4d71-9618-f1d42363dfa4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:31.036402 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43ca4383-5444-4d71-9618-f1d42363dfa4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:31.037185 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43ca4383-5444-4d71-9618-f1d42363dfa4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:31.037614 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-43ca4383-5444-4d71-9618-f1d42363dfa4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:31.121888 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fed96726-8176-45b8-98bf-0359270becc0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:31.122734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fed96726-8176-45b8-98bf-0359270becc0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:31.129365 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fed96726-8176-45b8-98bf-0359270becc0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:31.129812 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fed96726-8176-45b8-98bf-0359270becc0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:31.130564 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fed96726-8176-45b8-98bf-0359270becc0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:31.130995 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fed96726-8176-45b8-98bf-0359270becc0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:31.181478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-43ca4383-5444-4d71-9618-f1d42363dfa4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:31.189452 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-43ca4383-5444-4d71-9618-f1d42363dfa4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1318 microversion: 2.1 time: 0.165295 Jul 12 07:21:31.189994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 478/963] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:31 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:31.265904 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fed96726-8176-45b8-98bf-0359270becc0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:31.273776 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fed96726-8176-45b8-98bf-0359270becc0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1311 microversion: 2.1 time: 0.157913 Jul 12 07:21:31.274349 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 486/964] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:31 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1311 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:31.562267 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-9f2a81a2-0425-49f3-bde9-0e2fcaf65216 req-8e9fda8f-73fe-41c3-a0fd-6bc3abf81043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d56d2c-4636-47ad-a4d1-45963993cddb", "name": "network-vif-plugged", "status": "completed", "tag": "1ddb0724-4b84-43f8-afba-2522dfbcbd94"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:31.565778 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:31.571959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-9f2a81a2-0425-49f3-bde9-0e2fcaf65216 req-8e9fda8f-73fe-41c3-a0fd-6bc3abf81043 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:31.572399 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-9f2a81a2-0425-49f3-bde9-0e2fcaf65216 req-8e9fda8f-73fe-41c3-a0fd-6bc3abf81043 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:31.585172 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-9f2a81a2-0425-49f3-bde9-0e2fcaf65216 req-8e9fda8f-73fe-41c3-a0fd-6bc3abf81043 service nova] Creating event network-vif-plugged:1ddb0724-4b84-43f8-afba-2522dfbcbd94 for instance d3d56d2c-4636-47ad-a4d1-45963993cddb on hv-cinder-82549 Jul 12 07:21:31.590247 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-9f2a81a2-0425-49f3-bde9-0e2fcaf65216 req-8e9fda8f-73fe-41c3-a0fd-6bc3abf81043 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031688 Jul 12 07:21:31.590826 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 479/965] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:31.608132 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-669e4ec1-45e7-49e8-b231-253737766477 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:31.608822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-669e4ec1-45e7-49e8-b231-253737766477 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:31.615225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-669e4ec1-45e7-49e8-b231-253737766477 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:31.615746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-669e4ec1-45e7-49e8-b231-253737766477 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:31.616565 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-669e4ec1-45e7-49e8-b231-253737766477 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:31.617080 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-669e4ec1-45e7-49e8-b231-253737766477 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:31.737350 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-58d052cd-f5b5-45b0-ad3c-008b91c4e503 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:31.738036 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-58d052cd-f5b5-45b0-ad3c-008b91c4e503 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:31.744715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-58d052cd-f5b5-45b0-ad3c-008b91c4e503 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:31.745181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-58d052cd-f5b5-45b0-ad3c-008b91c4e503 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:31.745927 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-58d052cd-f5b5-45b0-ad3c-008b91c4e503 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:31.746446 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-58d052cd-f5b5-45b0-ad3c-008b91c4e503 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:31.749217 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-669e4ec1-45e7-49e8-b231-253737766477 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:31.756883 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-669e4ec1-45e7-49e8-b231-253737766477 tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1471 microversion: 2.1 time: 0.152731 Jul 12 07:21:31.757699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 487/966] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:31 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:31.894030 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-58d052cd-f5b5-45b0-ad3c-008b91c4e503 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:31.905401 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-58d052cd-f5b5-45b0-ad3c-008b91c4e503 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.172203 Jul 12 07:21:31.906167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 480/967] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:31 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:32.206974 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-44e73966-d5e8-42c9-a978-7702c4d12727 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:32.207586 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-44e73966-d5e8-42c9-a978-7702c4d12727 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:32.213585 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44e73966-d5e8-42c9-a978-7702c4d12727 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:32.214019 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44e73966-d5e8-42c9-a978-7702c4d12727 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:32.215069 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44e73966-d5e8-42c9-a978-7702c4d12727 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:32.215564 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44e73966-d5e8-42c9-a978-7702c4d12727 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:32.291609 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8be5e1f7-4b38-4fe9-945a-44467f18b61d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:32.292204 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8be5e1f7-4b38-4fe9-945a-44467f18b61d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:32.299146 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8be5e1f7-4b38-4fe9-945a-44467f18b61d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:32.299875 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8be5e1f7-4b38-4fe9-945a-44467f18b61d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:32.300931 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8be5e1f7-4b38-4fe9-945a-44467f18b61d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:32.301459 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8be5e1f7-4b38-4fe9-945a-44467f18b61d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:32.802082 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-44e73966-d5e8-42c9-a978-7702c4d12727 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:32.810246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-44e73966-d5e8-42c9-a978-7702c4d12727 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1318 microversion: 2.1 time: 0.607210 Jul 12 07:21:32.820145 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 488/968] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:32 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:32.825592 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-58183114-e4ae-46ad-92da-a42e566e015e tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:32.826189 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-58183114-e4ae-46ad-92da-a42e566e015e tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:32.830563 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8be5e1f7-4b38-4fe9-945a-44467f18b61d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:32.839689 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8be5e1f7-4b38-4fe9-945a-44467f18b61d tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1311 microversion: 2.1 time: 0.552105 Jul 12 07:21:32.840492 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 481/969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:32 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1311 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:32.840610 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58183114-e4ae-46ad-92da-a42e566e015e tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:32.840965 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58183114-e4ae-46ad-92da-a42e566e015e tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:32.841869 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58183114-e4ae-46ad-92da-a42e566e015e tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:32.842299 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58183114-e4ae-46ad-92da-a42e566e015e tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:32.923426 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-91980a5b-fdb3-48f9-a9ce-5ec767635c31 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:32.924041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-91980a5b-fdb3-48f9-a9ce-5ec767635c31 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:32.930994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-91980a5b-fdb3-48f9-a9ce-5ec767635c31 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:32.931191 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-91980a5b-fdb3-48f9-a9ce-5ec767635c31 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:32.937607 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-91980a5b-fdb3-48f9-a9ce-5ec767635c31 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:32.938238 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-91980a5b-fdb3-48f9-a9ce-5ec767635c31 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:33.092022 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58183114-e4ae-46ad-92da-a42e566e015e tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:33.100260 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-58183114-e4ae-46ad-92da-a42e566e015e tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1471 microversion: 2.1 time: 0.278759 Jul 12 07:21:33.100923 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 489/970] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:32 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:33.106091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-409dea2c-fe4d-4f75-a001-7b2250ce5fd8 req-658a2be8-3986-49c1-b734-b3f9dfa21111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb132a0-aee0-4923-b749-4e13397358cb", "name": "network-vif-deleted", "tag": "d7ee7411-0658-481a-a2ac-6c89bbe93312"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:33.117441 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-409dea2c-fe4d-4f75-a001-7b2250ce5fd8 req-658a2be8-3986-49c1-b734-b3f9dfa21111 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:33.117877 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-409dea2c-fe4d-4f75-a001-7b2250ce5fd8 req-658a2be8-3986-49c1-b734-b3f9dfa21111 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:33.130313 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-409dea2c-fe4d-4f75-a001-7b2250ce5fd8 req-658a2be8-3986-49c1-b734-b3f9dfa21111 service nova] Creating event network-vif-deleted:d7ee7411-0658-481a-a2ac-6c89bbe93312 for instance 7eb132a0-aee0-4923-b749-4e13397358cb on hv-cinder-82549 Jul 12 07:21:33.136219 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-409dea2c-fe4d-4f75-a001-7b2250ce5fd8 req-658a2be8-3986-49c1-b734-b3f9dfa21111 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033847 Jul 12 07:21:33.137815 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 490/971] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:33.146356 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-91980a5b-fdb3-48f9-a9ce-5ec767635c31 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:33.154678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-91980a5b-fdb3-48f9-a9ce-5ec767635c31 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.235094 Jul 12 07:21:33.155274 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 482/972] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:32 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:33.831447 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6c7ce2ea-013f-4693-9f68-423a47656ff2 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:33.832139 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6c7ce2ea-013f-4693-9f68-423a47656ff2 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:33.839075 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c7ce2ea-013f-4693-9f68-423a47656ff2 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:33.839498 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c7ce2ea-013f-4693-9f68-423a47656ff2 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:33.840246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c7ce2ea-013f-4693-9f68-423a47656ff2 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:33.840673 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c7ce2ea-013f-4693-9f68-423a47656ff2 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:33.857194 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8b1a0a7b-e047-4066-a859-227ba539c1ec tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:33.857994 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8b1a0a7b-e047-4066-a859-227ba539c1ec tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:33.865101 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b1a0a7b-e047-4066-a859-227ba539c1ec tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:33.865557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b1a0a7b-e047-4066-a859-227ba539c1ec tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:33.866350 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b1a0a7b-e047-4066-a859-227ba539c1ec tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:33.866795 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8b1a0a7b-e047-4066-a859-227ba539c1ec tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.048777 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6c7ce2ea-013f-4693-9f68-423a47656ff2 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:34.060629 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6c7ce2ea-013f-4693-9f68-423a47656ff2 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1318 microversion: 2.1 time: 0.235290 Jul 12 07:21:34.073805 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 491/973] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:33 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:34.075055 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8b1a0a7b-e047-4066-a859-227ba539c1ec tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:34.083234 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8b1a0a7b-e047-4066-a859-227ba539c1ec tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1494 microversion: 2.1 time: 0.230060 Jul 12 07:21:34.084104 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 483/974] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:33 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1494 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:34.117572 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:34.118274 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:34.124620 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:34.125225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.125845 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:34.126246 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.159119 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:34.159797 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.160065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lazy-loading 'fault' on Instance uuid 7eb132a0-aee0-4923-b749-4e13397358cb {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:21:34.171589 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-52612ca8-ec93-492f-b736-623d7404c6e6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:34.172195 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-52612ca8-ec93-492f-b736-623d7404c6e6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:34.178744 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52612ca8-ec93-492f-b736-623d7404c6e6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:34.179180 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52612ca8-ec93-492f-b736-623d7404c6e6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.179943 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52612ca8-ec93-492f-b736-623d7404c6e6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:34.180373 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-52612ca8-ec93-492f-b736-623d7404c6e6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.202685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e149f2b896405d863c98530333392b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba27eb979944a96a89df10c7e0b6dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:34.210523 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-13ad3e1a-95d0-4db1-8ddf-ee393a5b47bf tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 200 len: 1305 microversion: 2.1 time: 0.096851 Jul 12 07:21:34.211157 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 492/975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:34 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:34.314884 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-52612ca8-ec93-492f-b736-623d7404c6e6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:34.322649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-52612ca8-ec93-492f-b736-623d7404c6e6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.155017 Jul 12 07:21:34.323227 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 484/976] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:34 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:34.645471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8275bf00-3264-4482-a9ef-57eda0e4d32c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:34.646069 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8275bf00-3264-4482-a9ef-57eda0e4d32c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:34.652497 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8275bf00-3264-4482-a9ef-57eda0e4d32c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:34.652935 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8275bf00-3264-4482-a9ef-57eda0e4d32c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.653719 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8275bf00-3264-4482-a9ef-57eda0e4d32c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:34.654141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8275bf00-3264-4482-a9ef-57eda0e4d32c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.680167 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8275bf00-3264-4482-a9ef-57eda0e4d32c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:21:34.741376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:34.758552 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8275bf00-3264-4482-a9ef-57eda0e4d32c tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 204 len: 0 microversion: 2.1 time: 0.117157 Jul 12 07:21:34.759137 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 493/977] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:21:34 2022] DELETE /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:21:34.767325 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4663d6cf-9c5f-4d66-b351-3e4d854403fb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:34.767931 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4663d6cf-9c5f-4d66-b351-3e4d854403fb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:34.774016 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4663d6cf-9c5f-4d66-b351-3e4d854403fb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:34.774456 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4663d6cf-9c5f-4d66-b351-3e4d854403fb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.775213 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4663d6cf-9c5f-4d66-b351-3e4d854403fb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:34.775640 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4663d6cf-9c5f-4d66-b351-3e4d854403fb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:34.914502 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4663d6cf-9c5f-4d66-b351-3e4d854403fb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:34.922396 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4663d6cf-9c5f-4d66-b351-3e4d854403fb tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1500 microversion: 2.1 time: 0.158923 Jul 12 07:21:34.922985 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 485/978] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:34 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:35.085596 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-42a401c5-eda9-4b28-9027-90e95017a13c tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:35.086651 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-42a401c5-eda9-4b28-9027-90e95017a13c tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:35.097367 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42a401c5-eda9-4b28-9027-90e95017a13c tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:35.097739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42a401c5-eda9-4b28-9027-90e95017a13c tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:35.098680 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42a401c5-eda9-4b28-9027-90e95017a13c tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:35.099109 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42a401c5-eda9-4b28-9027-90e95017a13c tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:35.229752 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:35.230351 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] [instance: 7eb132a0-aee0-4923-b749-4e13397358cb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:35.233673 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-42a401c5-eda9-4b28-9027-90e95017a13c tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:35.236799 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:35.237281 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:35.238139 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:35.238568 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:35.241963 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-42a401c5-eda9-4b28-9027-90e95017a13c tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1318 microversion: 2.1 time: 0.163281 Jul 12 07:21:35.242636 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 494/979] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:35 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:35.252434 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] HTTP exception thrown: Instance 7eb132a0-aee0-4923-b749-4e13397358cb could not be found. Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Request method failure captured: Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb HTTP/1.1 Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizSDlKilINvo6xaoa5F-OEPVieqEhfYTCgTE-3dDdUlCUzT6olEvRVWvYBtCAKQ-6yRFY3b8UbcjYnJKnWvQLUagAtkHA4cYYSkpWhTCof3GJULNsU4jhR7XuFHQdrId_WPvrKWaP09vdk97rWfCrXKSdIEJFsu51wFdTBvPvaRMh3Bo Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 4ba27eb979944a96a89df10c7e0b6dca Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-VolumesNegativeTest-69617793 Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:21:35.254181 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4ba27eb979944a96a89df10c7e0b6dca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4ba27eb979944a96a89df10c7e0b6dca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4ba27eb979944a96a89df10c7e0b6dca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4ba27eb979944a96a89df10c7e0b6dca"}]}] Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-VolumesNegativeTest-69617793 Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 4ba27eb979944a96a89df10c7e0b6dca Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-VolumesNegativeTest-69617793 Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-VolumesNegativeTest-69617793-project Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 06e149f2b896405d863c98530333392b Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-VolumesNegativeTest-69617793-project Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 7eb132a0-aee0-4923-b749-4e13397358cb could not be found. Jul 12 07:21:35.255813 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '7eb132a0-aee0-4923-b749-4e13397358cb'} Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb132a0-aee0-4923-b749-4e13397358cb could not be found. Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:21:35.256715 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb132a0-aee0-4923-b749-4e13397358cb could not be found. Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb132a0-aee0-4923-b749-4e13397358cb could not be found. Jul 12 07:21:35.258252 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:21:35.259432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] Returning 404 to user: Instance 7eb132a0-aee0-4923-b749-4e13397358cb could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:21:35.259432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4354eda2-37b0-40aa-97b2-23a8eace27ac tempest-VolumesNegativeTest-69617793 tempest-VolumesNegativeTest-69617793-project] 10.222.0.25 "GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb" status: 404 len: 111 microversion: 2.1 time: 0.029759 Jul 12 07:21:35.259432 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 486/980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:35 2022] GET /compute/v2.1/servers/7eb132a0-aee0-4923-b749-4e13397358cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:21:35.340096 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f643450-6714-47aa-97ec-130c75a90636 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:35.340982 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2f643450-6714-47aa-97ec-130c75a90636 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:35.348530 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f643450-6714-47aa-97ec-130c75a90636 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:35.348903 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f643450-6714-47aa-97ec-130c75a90636 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:35.349830 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f643450-6714-47aa-97ec-130c75a90636 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:35.350439 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f643450-6714-47aa-97ec-130c75a90636 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:35.492110 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2f643450-6714-47aa-97ec-130c75a90636 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:35.499783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2f643450-6714-47aa-97ec-130c75a90636 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.163987 Jul 12 07:21:35.500590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 495/981] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:35 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:35.657703 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-63f80906-384e-488d-8cac-9fe30e5bfd64 req-002bf3fc-dab1-4c5b-ada9-8ed06a1177d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03413629-3056-435a-a80f-bddd5848a6c8", "name": "network-vif-plugged", "status": "completed", "tag": "c4e27f35-9d2e-4791-b805-d15308b97a37"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:35.667133 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-63f80906-384e-488d-8cac-9fe30e5bfd64 req-002bf3fc-dab1-4c5b-ada9-8ed06a1177d9 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:35.667573 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-63f80906-384e-488d-8cac-9fe30e5bfd64 req-002bf3fc-dab1-4c5b-ada9-8ed06a1177d9 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:35.679731 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-63f80906-384e-488d-8cac-9fe30e5bfd64 req-002bf3fc-dab1-4c5b-ada9-8ed06a1177d9 service nova] Creating event network-vif-plugged:c4e27f35-9d2e-4791-b805-d15308b97a37 for instance 03413629-3056-435a-a80f-bddd5848a6c8 on hv-cinder-82549 Jul 12 07:21:35.684886 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-63f80906-384e-488d-8cac-9fe30e5bfd64 req-002bf3fc-dab1-4c5b-ada9-8ed06a1177d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Jul 12 07:21:35.685761 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 487/982] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:35.940140 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c1cf28a3-849e-41c5-83ae-80ca3fabdbd0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:35.940659 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c1cf28a3-849e-41c5-83ae-80ca3fabdbd0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:35.942751 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=4 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:35.943399 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=14 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:35.950509 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1cf28a3-849e-41c5-83ae-80ca3fabdbd0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:35.950954 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1cf28a3-849e-41c5-83ae-80ca3fabdbd0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:35.951723 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1cf28a3-849e-41c5-83ae-80ca3fabdbd0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:35.952151 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1cf28a3-849e-41c5-83ae-80ca3fabdbd0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:35.970704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:36.094420 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c1cf28a3-849e-41c5-83ae-80ca3fabdbd0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:36.102071 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c1cf28a3-849e-41c5-83ae-80ca3fabdbd0 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1500 microversion: 2.1 time: 0.166016 Jul 12 07:21:36.102752 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 496/983] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:35 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:36.257090 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=10 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:36.261292 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-1eb18e9b-dfa8-4172-93fc-3954a9ce469d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:36.261986 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-1eb18e9b-dfa8-4172-93fc-3954a9ce469d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:36.268699 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1eb18e9b-dfa8-4172-93fc-3954a9ce469d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:36.269521 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1eb18e9b-dfa8-4172-93fc-3954a9ce469d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:36.270150 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1eb18e9b-dfa8-4172-93fc-3954a9ce469d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:36.270593 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-1eb18e9b-dfa8-4172-93fc-3954a9ce469d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:36.416474 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-1eb18e9b-dfa8-4172-93fc-3954a9ce469d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:36.424510 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-1eb18e9b-dfa8-4172-93fc-3954a9ce469d tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1318 microversion: 2.1 time: 0.168817 Jul 12 07:21:36.425103 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 488/984] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:36 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:36.517259 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-622c5db9-c563-4674-989c-42770705b0fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:36.517847 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-622c5db9-c563-4674-989c-42770705b0fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:36.524222 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-622c5db9-c563-4674-989c-42770705b0fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:36.524828 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-622c5db9-c563-4674-989c-42770705b0fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:36.525610 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-622c5db9-c563-4674-989c-42770705b0fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:36.526417 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-622c5db9-c563-4674-989c-42770705b0fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:36.669097 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-622c5db9-c563-4674-989c-42770705b0fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:36.676950 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-622c5db9-c563-4674-989c-42770705b0fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.163671 Jul 12 07:21:36.681090 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 497/985] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:36 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:37.120555 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-67b69b52-31a1-4e41-94cc-77fb69012328 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:37.121220 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-67b69b52-31a1-4e41-94cc-77fb69012328 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:37.138232 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67b69b52-31a1-4e41-94cc-77fb69012328 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:37.138620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67b69b52-31a1-4e41-94cc-77fb69012328 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:37.139516 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67b69b52-31a1-4e41-94cc-77fb69012328 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:37.139963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-67b69b52-31a1-4e41-94cc-77fb69012328 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:37.318050 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-67b69b52-31a1-4e41-94cc-77fb69012328 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:37.326161 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-67b69b52-31a1-4e41-94cc-77fb69012328 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1500 microversion: 2.1 time: 0.209509 Jul 12 07:21:37.326737 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 489/986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:37 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1500 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:37.442654 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-06339941-f59d-42e6-951e-50b85db259f1 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:37.443254 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-06339941-f59d-42e6-951e-50b85db259f1 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:37.450946 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06339941-f59d-42e6-951e-50b85db259f1 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:37.451523 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06339941-f59d-42e6-951e-50b85db259f1 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:37.452266 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06339941-f59d-42e6-951e-50b85db259f1 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:37.452717 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06339941-f59d-42e6-951e-50b85db259f1 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:37.601037 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-06339941-f59d-42e6-951e-50b85db259f1 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:37.613129 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-06339941-f59d-42e6-951e-50b85db259f1 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1318 microversion: 2.1 time: 0.174631 Jul 12 07:21:37.613712 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 498/987] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:37 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:37.641588 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-78e939d1-228d-42c9-b3e7-1686615d97ee req-9d27a170-dc23-432c-a02f-163c83d2ceab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d56d2c-4636-47ad-a4d1-45963993cddb", "name": "network-vif-deleted", "tag": "1ddb0724-4b84-43f8-afba-2522dfbcbd94"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:37.650599 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-78e939d1-228d-42c9-b3e7-1686615d97ee req-9d27a170-dc23-432c-a02f-163c83d2ceab service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:37.651406 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-78e939d1-228d-42c9-b3e7-1686615d97ee req-9d27a170-dc23-432c-a02f-163c83d2ceab service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:37.662821 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-78e939d1-228d-42c9-b3e7-1686615d97ee req-9d27a170-dc23-432c-a02f-163c83d2ceab service nova] Creating event network-vif-deleted:1ddb0724-4b84-43f8-afba-2522dfbcbd94 for instance d3d56d2c-4636-47ad-a4d1-45963993cddb on hv-cinder-82549 Jul 12 07:21:37.667907 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-78e939d1-228d-42c9-b3e7-1686615d97ee req-9d27a170-dc23-432c-a02f-163c83d2ceab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030061 Jul 12 07:21:37.668493 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 490/988] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:37.693966 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-db370afd-30f8-4c36-806b-3ce91bd78917 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:37.694647 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-db370afd-30f8-4c36-806b-3ce91bd78917 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:37.701279 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db370afd-30f8-4c36-806b-3ce91bd78917 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:37.701923 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db370afd-30f8-4c36-806b-3ce91bd78917 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:37.702768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db370afd-30f8-4c36-806b-3ce91bd78917 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:37.703514 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db370afd-30f8-4c36-806b-3ce91bd78917 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:37.844547 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-db370afd-30f8-4c36-806b-3ce91bd78917 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:37.852559 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-db370afd-30f8-4c36-806b-3ce91bd78917 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.162637 Jul 12 07:21:37.853420 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 499/989] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:37 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:38.345617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:38.346303 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:38.354775 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:38.355273 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:38.356110 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:38.356702 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:38.388327 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:38.388798 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:38.389285 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lazy-loading 'fault' on Instance uuid d3d56d2c-4636-47ad-a4d1-45963993cddb {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:21:38.438113 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aff23c6c4f6473eba8c6bc659345ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f78fe1ecaca42d2ae09999dcb3c8d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:38.446469 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a39c91c2-9395-4918-b3eb-e48fcb023e70 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 200 len: 1301 microversion: 2.1 time: 0.106026 Jul 12 07:21:38.447681 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 491/990] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:38 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:38.631153 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a89637ad-2ebf-491d-8971-95ac6bba32cd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:38.631753 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a89637ad-2ebf-491d-8971-95ac6bba32cd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:38.638604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a89637ad-2ebf-491d-8971-95ac6bba32cd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:38.639040 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a89637ad-2ebf-491d-8971-95ac6bba32cd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:38.639792 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a89637ad-2ebf-491d-8971-95ac6bba32cd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:38.640206 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a89637ad-2ebf-491d-8971-95ac6bba32cd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:38.772341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a89637ad-2ebf-491d-8971-95ac6bba32cd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:38.780383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a89637ad-2ebf-491d-8971-95ac6bba32cd tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1507 microversion: 2.1 time: 0.153537 Jul 12 07:21:38.780959 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 500/991] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:38 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:38.799923 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b685a094-3769-4803-a68f-539a5f22a9be tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca055c60-f3cc-4e41-b0ab-945b19dc27b9", "device": "/dev/sdb"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:38.801714 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b685a094-3769-4803-a68f-539a5f22a9be tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:38.808009 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b685a094-3769-4803-a68f-539a5f22a9be tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:38.808460 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b685a094-3769-4803-a68f-539a5f22a9be tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:38.809268 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b685a094-3769-4803-a68f-539a5f22a9be tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:38.809704 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b685a094-3769-4803-a68f-539a5f22a9be tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:38.870201 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eb53f9db-3613-42f7-a6f4-7414483ca7d1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:38.870803 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eb53f9db-3613-42f7-a6f4-7414483ca7d1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:38.877141 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb53f9db-3613-42f7-a6f4-7414483ca7d1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:38.877587 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb53f9db-3613-42f7-a6f4-7414483ca7d1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:38.878345 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb53f9db-3613-42f7-a6f4-7414483ca7d1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:38.878772 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb53f9db-3613-42f7-a6f4-7414483ca7d1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:39.012488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eb53f9db-3613-42f7-a6f4-7414483ca7d1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:39.020614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eb53f9db-3613-42f7-a6f4-7414483ca7d1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.154128 Jul 12 07:21:39.021378 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 501/992] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:38 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:39.262367 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:39.272373 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b685a094-3769-4803-a68f-539a5f22a9be tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "POST /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478903 Jul 12 07:21:39.272990 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 492/993] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:21:38 2022] POST /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:39.469677 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:39.470374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] [instance: d3d56d2c-4636-47ad-a4d1-45963993cddb] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:39.477884 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:39.478810 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:39.479582 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:39.480511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:39.495956 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] HTTP exception thrown: Instance d3d56d2c-4636-47ad-a4d1-45963993cddb could not be found. Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Request method failure captured: Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb HTTP/1.1 Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSDNhG_BBJVNr16WwPgPKdPqFYyMwhg9Hnnj0z2_Afnw6X59nf6QpL8Jb8paa0_98GQ-tys3n9_qgE1kclURVAoNe4vYPAadF7FkwLHQShnv5rKKtd-oB91XTDmBKY0np5lvX-QIZjxVi9UDXw0woRudQcVrcGjjj11XtlRQNMSZvY4 Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 3f78fe1ecaca42d2ae09999dcb3c8d7c Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesActionsTest-1344863893 Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:21:39.497790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f78fe1ecaca42d2ae09999dcb3c8d7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f78fe1ecaca42d2ae09999dcb3c8d7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f78fe1ecaca42d2ae09999dcb3c8d7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f78fe1ecaca42d2ae09999dcb3c8d7c"}]}] Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesActionsTest-1344863893 Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 3f78fe1ecaca42d2ae09999dcb3c8d7c Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesActionsTest-1344863893 Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesActionsTest-1344863893-project Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 1aff23c6c4f6473eba8c6bc659345ba9 Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesActionsTest-1344863893-project Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance d3d56d2c-4636-47ad-a4d1-45963993cddb could not be found. Jul 12 07:21:39.499295 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'd3d56d2c-4636-47ad-a4d1-45963993cddb'} Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d56d2c-4636-47ad-a4d1-45963993cddb could not be found. Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:21:39.500115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d56d2c-4636-47ad-a4d1-45963993cddb could not be found. Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d56d2c-4636-47ad-a4d1-45963993cddb could not be found. Jul 12 07:21:39.501538 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:21:39.502791 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] Returning 404 to user: Instance d3d56d2c-4636-47ad-a4d1-45963993cddb could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:21:39.502791 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0b0a5e1b-f283-4d20-a23c-6d44e88d52a9 tempest-VolumesActionsTest-1344863893 tempest-VolumesActionsTest-1344863893-project] 10.222.0.25 "GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb" status: 404 len: 111 microversion: 2.1 time: 0.033452 Jul 12 07:21:39.502791 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 502/994] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:39 2022] GET /compute/v2.1/servers/d3d56d2c-4636-47ad-a4d1-45963993cddb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:21:40.042457 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f219d5d1-524d-4f2d-88fe-42a200eeb6ae tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:40.043150 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f219d5d1-524d-4f2d-88fe-42a200eeb6ae tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:40.050924 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f219d5d1-524d-4f2d-88fe-42a200eeb6ae tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:40.051746 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f219d5d1-524d-4f2d-88fe-42a200eeb6ae tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:40.052525 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f219d5d1-524d-4f2d-88fe-42a200eeb6ae tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:40.052964 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f219d5d1-524d-4f2d-88fe-42a200eeb6ae tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:40.210364 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f219d5d1-524d-4f2d-88fe-42a200eeb6ae tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:40.219183 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f219d5d1-524d-4f2d-88fe-42a200eeb6ae tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.184011 Jul 12 07:21:40.219882 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 493/995] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:40 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:41.236506 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-686d568f-8cd2-4fd0-abb4-6226a989e4d3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:41.237877 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-686d568f-8cd2-4fd0-abb4-6226a989e4d3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:41.245481 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-686d568f-8cd2-4fd0-abb4-6226a989e4d3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:41.246277 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-686d568f-8cd2-4fd0-abb4-6226a989e4d3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:41.247221 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-686d568f-8cd2-4fd0-abb4-6226a989e4d3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:41.247813 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-686d568f-8cd2-4fd0-abb4-6226a989e4d3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:41.397300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-686d568f-8cd2-4fd0-abb4-6226a989e4d3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:41.408485 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-686d568f-8cd2-4fd0-abb4-6226a989e4d3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.176052 Jul 12 07:21:41.409150 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 503/996] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:41 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:21:42.426246 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f7f1df2b-ecaf-4c2c-978f-5a48c4890946 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:42.426846 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f7f1df2b-ecaf-4c2c-978f-5a48c4890946 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:42.433799 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7f1df2b-ecaf-4c2c-978f-5a48c4890946 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:42.434223 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7f1df2b-ecaf-4c2c-978f-5a48c4890946 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:42.434981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7f1df2b-ecaf-4c2c-978f-5a48c4890946 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:42.435415 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7f1df2b-ecaf-4c2c-978f-5a48c4890946 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:42.574915 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f7f1df2b-ecaf-4c2c-978f-5a48c4890946 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:42.583208 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f7f1df2b-ecaf-4c2c-978f-5a48c4890946 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.160707 Jul 12 07:21:42.583846 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 494/997] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:42 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:43.600908 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-36611de3-035c-4b66-8627-e3cbc8aee44a tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:43.601567 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-36611de3-035c-4b66-8627-e3cbc8aee44a tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:43.609330 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36611de3-035c-4b66-8627-e3cbc8aee44a tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:43.610121 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36611de3-035c-4b66-8627-e3cbc8aee44a tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:43.611142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36611de3-035c-4b66-8627-e3cbc8aee44a tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:43.612169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36611de3-035c-4b66-8627-e3cbc8aee44a tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:43.778194 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-36611de3-035c-4b66-8627-e3cbc8aee44a tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:43.789197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-36611de3-035c-4b66-8627-e3cbc8aee44a tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.192956 Jul 12 07:21:43.790025 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 504/998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:43 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:43.824499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-8cc541c7-fb63-4d37-85fa-b6abb0a23648 req-9c6f2ac2-38f5-4dce-8f79-791121a60f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3776b5e2-d4ea-4709-9f38-44945b6ff3f3", "name": "network-vif-plugged", "status": "completed", "tag": "dfa4e3d1-b3f0-43a9-b856-0e0a60dc1a3e"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:43.836218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8cc541c7-fb63-4d37-85fa-b6abb0a23648 req-9c6f2ac2-38f5-4dce-8f79-791121a60f0a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:43.836940 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-8cc541c7-fb63-4d37-85fa-b6abb0a23648 req-9c6f2ac2-38f5-4dce-8f79-791121a60f0a service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:43.849251 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-8cc541c7-fb63-4d37-85fa-b6abb0a23648 req-9c6f2ac2-38f5-4dce-8f79-791121a60f0a service nova] Creating event network-vif-plugged:dfa4e3d1-b3f0-43a9-b856-0e0a60dc1a3e for instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 on hv-cinder-82549 Jul 12 07:21:43.856022 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-8cc541c7-fb63-4d37-85fa-b6abb0a23648 req-9c6f2ac2-38f5-4dce-8f79-791121a60f0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036329 Jul 12 07:21:43.857289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 495/999] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:44.807048 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e4c6414-2e4f-4c67-9964-b179c5434c95 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:44.807655 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2e4c6414-2e4f-4c67-9964-b179c5434c95 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:44.814744 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e4c6414-2e4f-4c67-9964-b179c5434c95 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:44.825733 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e4c6414-2e4f-4c67-9964-b179c5434c95 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:44.828940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e4c6414-2e4f-4c67-9964-b179c5434c95 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:44.829629 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e4c6414-2e4f-4c67-9964-b179c5434c95 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:45.070380 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2e4c6414-2e4f-4c67-9964-b179c5434c95 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:45.078961 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e4c6414-2e4f-4c67-9964-b179c5434c95 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1265 microversion: 2.1 time: 0.276164 Jul 12 07:21:45.080265 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 505/1000] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:44 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:46.100855 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7fd4dafd-79cd-41e0-8f33-5fa79575f464 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:46.106499 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7fd4dafd-79cd-41e0-8f33-5fa79575f464 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:46.124886 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7fd4dafd-79cd-41e0-8f33-5fa79575f464 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:46.126865 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7fd4dafd-79cd-41e0-8f33-5fa79575f464 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:46.133172 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7fd4dafd-79cd-41e0-8f33-5fa79575f464 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:46.135592 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7fd4dafd-79cd-41e0-8f33-5fa79575f464 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:46.390873 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7fd4dafd-79cd-41e0-8f33-5fa79575f464 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:46.404098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7fd4dafd-79cd-41e0-8f33-5fa79575f464 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1452 microversion: 2.1 time: 0.308506 Jul 12 07:21:46.404929 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 496/1001] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:46 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1452 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:46.422692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b62f03fb-c2c2-4134-ad79-6bf3acddb134 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:46.423396 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b62f03fb-c2c2-4134-ad79-6bf3acddb134 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:46.431830 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b62f03fb-c2c2-4134-ad79-6bf3acddb134 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:46.432410 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b62f03fb-c2c2-4134-ad79-6bf3acddb134 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:46.433462 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b62f03fb-c2c2-4134-ad79-6bf3acddb134 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:46.434002 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b62f03fb-c2c2-4134-ad79-6bf3acddb134 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:46.710106 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b62f03fb-c2c2-4134-ad79-6bf3acddb134 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:21:46.731870 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b62f03fb-c2c2-4134-ad79-6bf3acddb134 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1452 microversion: 2.1 time: 0.314941 Jul 12 07:21:46.748869 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 506/1002] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:21:46 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1452 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:21:51.579849 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-5db6ba7e-0746-4852-876e-c303c2bb7fee req-a3d1db25-966a-44b7-98b1-52cbae6fefdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3776b5e2-d4ea-4709-9f38-44945b6ff3f3", "tag": "dfa4e3d1-b3f0-43a9-b856-0e0a60dc1a3e"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:21:51.599024 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5db6ba7e-0746-4852-876e-c303c2bb7fee req-a3d1db25-966a-44b7-98b1-52cbae6fefdf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:51.599761 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-5db6ba7e-0746-4852-876e-c303c2bb7fee req-a3d1db25-966a-44b7-98b1-52cbae6fefdf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:51.636069 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-5db6ba7e-0746-4852-876e-c303c2bb7fee req-a3d1db25-966a-44b7-98b1-52cbae6fefdf service nova] Creating event network-changed:dfa4e3d1-b3f0-43a9-b856-0e0a60dc1a3e for instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 on hv-cinder-82549 Jul 12 07:21:51.649265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-5db6ba7e-0746-4852-876e-c303c2bb7fee req-a3d1db25-966a-44b7-98b1-52cbae6fefdf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072992 Jul 12 07:21:51.651716 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 497/1003] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:21:59.713439 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9dbc9af-d324-4cc1-b1ae-f948f976e134 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:21:59.714053 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d9dbc9af-d324-4cc1-b1ae-f948f976e134 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:21:59.722883 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:59.726963 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=58 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:21:59.731740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9dbc9af-d324-4cc1-b1ae-f948f976e134 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:59.733091 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9dbc9af-d324-4cc1-b1ae-f948f976e134 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:59.736126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9dbc9af-d324-4cc1-b1ae-f948f976e134 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:21:59.736786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9dbc9af-d324-4cc1-b1ae-f948f976e134 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:21:59.860740 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-d9dbc9af-d324-4cc1-b1ae-f948f976e134 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lazy-loading 'services' on Instance uuid 03413629-3056-435a-a80f-bddd5848a6c8 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:21:59.996965 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d9dbc9af-d324-4cc1-b1ae-f948f976e134 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8/os-volume_attachments/ca055c60-f3cc-4e41-b0ab-945b19dc27b9" status: 202 len: 0 microversion: 2.1 time: 0.288209 Jul 12 07:22:00.010947 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 507/1004] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:21:59 2022] DELETE /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8/os-volume_attachments/ca055c60-f3cc-4e41-b0ab-945b19dc27b9 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:22:01.220627 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-5319b404-7736-429e-b9f4-0be93201e2f4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:01.221278 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5319b404-7736-429e-b9f4-0be93201e2f4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:01.233570 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5319b404-7736-429e-b9f4-0be93201e2f4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:01.234210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5319b404-7736-429e-b9f4-0be93201e2f4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:01.235200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5319b404-7736-429e-b9f4-0be93201e2f4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:01.235743 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-5319b404-7736-429e-b9f4-0be93201e2f4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:01.271673 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-5319b404-7736-429e-b9f4-0be93201e2f4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:22:01.434550 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-5319b404-7736-429e-b9f4-0be93201e2f4 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 204 len: 0 microversion: 2.1 time: 0.221308 Jul 12 07:22:01.438008 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 498/1005] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:22:01 2022] DELETE /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:22:01.450816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-270a2efd-38a5-45e3-898e-084a1222717f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:01.453072 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-270a2efd-38a5-45e3-898e-084a1222717f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:01.474348 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-270a2efd-38a5-45e3-898e-084a1222717f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:01.476122 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-270a2efd-38a5-45e3-898e-084a1222717f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:01.479635 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-270a2efd-38a5-45e3-898e-084a1222717f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:01.481700 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-270a2efd-38a5-45e3-898e-084a1222717f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:01.904649 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-270a2efd-38a5-45e3-898e-084a1222717f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:01.915035 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-270a2efd-38a5-45e3-898e-084a1222717f tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1513 microversion: 2.1 time: 0.472311 Jul 12 07:22:01.915815 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 508/1006] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:01 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1513 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:02.933032 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-83b3718c-0d88-4d48-a0b5-00899cb24858 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:02.935283 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-83b3718c-0d88-4d48-a0b5-00899cb24858 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:02.940179 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:02.946930 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83b3718c-0d88-4d48-a0b5-00899cb24858 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:02.947380 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83b3718c-0d88-4d48-a0b5-00899cb24858 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:02.948167 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83b3718c-0d88-4d48-a0b5-00899cb24858 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:02.948605 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83b3718c-0d88-4d48-a0b5-00899cb24858 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:03.152632 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-83b3718c-0d88-4d48-a0b5-00899cb24858 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:03.160621 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-83b3718c-0d88-4d48-a0b5-00899cb24858 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1513 microversion: 2.1 time: 0.232138 Jul 12 07:22:03.170714 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 499/1007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:02 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:04.083739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-4f9b289f-281a-4507-98f3-1687c51b91b8 req-88405642-7860-4e11-9f86-75823f5c40ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03413629-3056-435a-a80f-bddd5848a6c8", "name": "network-vif-deleted", "tag": "c4e27f35-9d2e-4791-b805-d15308b97a37"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:22:04.099356 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4f9b289f-281a-4507-98f3-1687c51b91b8 req-88405642-7860-4e11-9f86-75823f5c40ff service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:04.099786 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4f9b289f-281a-4507-98f3-1687c51b91b8 req-88405642-7860-4e11-9f86-75823f5c40ff service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:04.117517 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-4f9b289f-281a-4507-98f3-1687c51b91b8 req-88405642-7860-4e11-9f86-75823f5c40ff service nova] Creating event network-vif-deleted:c4e27f35-9d2e-4791-b805-d15308b97a37 for instance 03413629-3056-435a-a80f-bddd5848a6c8 on hv-cinder-82549 Jul 12 07:22:04.134127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-4f9b289f-281a-4507-98f3-1687c51b91b8 req-88405642-7860-4e11-9f86-75823f5c40ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054252 Jul 12 07:22:04.146040 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 509/1008] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:22:04.206129 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:04.207903 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:04.240775 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:04.242665 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:04.245390 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:04.246229 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:04.307540 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:04.308500 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:04.309520 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lazy-loading 'fault' on Instance uuid 03413629-3056-435a-a80f-bddd5848a6c8 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:22:04.373513 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e060034139f420e8412b8a55f1b29a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15d014b88a444c28ae32f230d144e8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:04.383333 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-06528b61-18d0-4080-82d8-0d86708ff821 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 200 len: 1308 microversion: 2.1 time: 0.193828 Jul 12 07:22:04.386345 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 500/1009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:04 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:05.406383 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:05.407953 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] [instance: 03413629-3056-435a-a80f-bddd5848a6c8] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:05.417881 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:05.418521 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:05.419433 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:05.420021 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:05.436645 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] HTTP exception thrown: Instance 03413629-3056-435a-a80f-bddd5848a6c8 could not be found. Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Request method failure captured: Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 HTTP/1.1 Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSCmJD6uHcKT6r403adKca_a6ojR_UbvBlbFUERG9ICpPih3hdAswHKjCUWUwjeIodry0msjmfpPkuwsMcnlGUO0B2GDl1tkPX4CH7a8JpENXcXuBUzUZo4h7Ft46FKMZloua1mH-PFRuO-JlkJQj7tfVnR9L41OVObMyyYkankHIMA Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: f15d014b88a444c28ae32f230d144e8c Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1130096577 Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:22:05.438887 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f15d014b88a444c28ae32f230d144e8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f15d014b88a444c28ae32f230d144e8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f15d014b88a444c28ae32f230d144e8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f15d014b88a444c28ae32f230d144e8c"}]}] Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesSnapshotTestJSON-1130096577 Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: f15d014b88a444c28ae32f230d144e8c Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1130096577 Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesSnapshotTestJSON-1130096577-project Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 7e060034139f420e8412b8a55f1b29a2 Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesSnapshotTestJSON-1130096577-project Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance 03413629-3056-435a-a80f-bddd5848a6c8 could not be found. Jul 12 07:22:05.440768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '03413629-3056-435a-a80f-bddd5848a6c8'} Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03413629-3056-435a-a80f-bddd5848a6c8 could not be found. Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:22:05.441704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03413629-3056-435a-a80f-bddd5848a6c8 could not be found. Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03413629-3056-435a-a80f-bddd5848a6c8 could not be found. Jul 12 07:22:05.443323 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:22:05.444746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] Returning 404 to user: Instance 03413629-3056-435a-a80f-bddd5848a6c8 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:22:05.445537 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a5b2f8cc-c3ce-4c56-a565-6f6ef27c7ea3 tempest-VolumesSnapshotTestJSON-1130096577 tempest-VolumesSnapshotTestJSON-1130096577-project] 10.222.0.25 "GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8" status: 404 len: 111 microversion: 2.1 time: 0.044655 Jul 12 07:22:05.446558 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 510/1010] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:05 2022] GET /compute/v2.1/servers/03413629-3056-435a-a80f-bddd5848a6c8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:22:06.211501 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9c6fc69a-3514-4449-abbb-70184f9f1753 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Action: 'create', calling method: .version_select at 0x7f7011847af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1158660468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFZZvOLpEqsif+oXz/+JjPKLEd39UO6GJ/UWkpIP6PQkEv5mRuDyiFV5e+DuGI9bI7iNNQ0/w+/MOhLM28VHbACporMiKoJeGhHnB2Ktv6rP20GVWwgT222LYIMaxyK9Q=="}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:22:06.226437 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-9c6fc69a-3514-4449-abbb-70184f9f1753 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Getting quotas for project 34750fb4357248b7a99cc1f0baaad4ae. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:22:06.230449 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.quota [None req-9c6fc69a-3514-4449-abbb-70184f9f1753 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Getting quotas for user e824ff37e1724f549f1e113013c554fe and project 34750fb4357248b7a99cc1f0baaad4ae. Resources: {'key_pairs'} {{(pid=117998) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:22:06.257235 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9c6fc69a-3514-4449-abbb-70184f9f1753 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049190 Jul 12 07:22:06.258045 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 501/1011] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 07:22:06 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:22:06.308158 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1413370088", "imageRef": "b851ba50-1c4f-4e42-9e1a-186f41da8654", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1158660468", "networks": [{"uuid": "fddf75ef-0a74-4505-a912-a924fc181c73"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:22:06.359389 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] validate_networks() for [('fddf75ef-0a74-4505-a912-a924fc181c73', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:22:06.760188 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:22:06.760835 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:22:06.761041 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:22:06.761466 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:22:06.761862 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:22:06.772499 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:06.773280 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:06.774546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:06.775560 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:06.795779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Getting quotas for project 34750fb4357248b7a99cc1f0baaad4ae. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:22:06.799999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Getting quotas for user e824ff37e1724f549f1e113013c554fe and project 34750fb4357248b7a99cc1f0baaad4ae. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:22:06.812088 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:22:06.814320 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851ba50-1c4f-4e42-9e1a-186f41da8654',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:22:06.869520 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c646c7dd-6dc3-41e0-8e3e-0fa617efce6a tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565029 Jul 12 07:22:06.870211 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 511/1012] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:22:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:22:06.880456 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-36ebb85a-80ab-460d-9e10-9f703f0dd10c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:06.881043 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-36ebb85a-80ab-460d-9e10-9f703f0dd10c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:06.967777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-36ebb85a-80ab-460d-9e10-9f703f0dd10c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:06.976595 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-36ebb85a-80ab-460d-9e10-9f703f0dd10c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1259 microversion: 2.1 time: 0.100299 Jul 12 07:22:06.977491 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 502/1013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:06 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1259 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:07.998957 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4b9931f1-b8cb-4e16-8888-b7f9aee665e1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:07.999884 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4b9931f1-b8cb-4e16-8888-b7f9aee665e1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:08.011894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b9931f1-b8cb-4e16-8888-b7f9aee665e1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:08.012640 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b9931f1-b8cb-4e16-8888-b7f9aee665e1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:08.013997 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b9931f1-b8cb-4e16-8888-b7f9aee665e1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:08.014713 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b9931f1-b8cb-4e16-8888-b7f9aee665e1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:08.083142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4b9931f1-b8cb-4e16-8888-b7f9aee665e1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:08.093971 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4b9931f1-b8cb-4e16-8888-b7f9aee665e1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1263 microversion: 2.1 time: 0.102131 Jul 12 07:22:08.094815 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 512/1014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:07 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1263 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:09.120126 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e7b37f68-a621-4724-907f-ccb7af171275 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:09.121023 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e7b37f68-a621-4724-907f-ccb7af171275 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:09.130946 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e7b37f68-a621-4724-907f-ccb7af171275 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:09.131405 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e7b37f68-a621-4724-907f-ccb7af171275 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:09.132158 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e7b37f68-a621-4724-907f-ccb7af171275 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:09.132556 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e7b37f68-a621-4724-907f-ccb7af171275 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:09.193887 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e7b37f68-a621-4724-907f-ccb7af171275 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:09.201708 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e7b37f68-a621-4724-907f-ccb7af171275 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1255 microversion: 2.1 time: 0.088343 Jul 12 07:22:09.202289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 503/1015] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:09 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1255 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:10.219503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8cee8bfd-690b-4519-b3f2-2b17669a43ca tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:10.220210 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8cee8bfd-690b-4519-b3f2-2b17669a43ca tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:10.227454 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cee8bfd-690b-4519-b3f2-2b17669a43ca tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:10.227896 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cee8bfd-690b-4519-b3f2-2b17669a43ca tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:10.228677 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cee8bfd-690b-4519-b3f2-2b17669a43ca tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:10.229130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cee8bfd-690b-4519-b3f2-2b17669a43ca tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:10.291193 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8cee8bfd-690b-4519-b3f2-2b17669a43ca tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:10.298742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8cee8bfd-690b-4519-b3f2-2b17669a43ca tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1311 microversion: 2.1 time: 0.083240 Jul 12 07:22:10.299300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 513/1016] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:10 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:11.315817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f4c43fe7-4925-4970-be5b-319b81991e30 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:11.316505 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f4c43fe7-4925-4970-be5b-319b81991e30 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:11.323236 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4c43fe7-4925-4970-be5b-319b81991e30 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:11.324108 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4c43fe7-4925-4970-be5b-319b81991e30 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:11.325301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4c43fe7-4925-4970-be5b-319b81991e30 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:11.325988 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f4c43fe7-4925-4970-be5b-319b81991e30 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:11.331237 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=57,nova_cell1:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:11.412816 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f4c43fe7-4925-4970-be5b-319b81991e30 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:11.422549 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f4c43fe7-4925-4970-be5b-319b81991e30 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1317 microversion: 2.1 time: 0.110569 Jul 12 07:22:11.423616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 504/1017] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:11 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1317 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:12.440968 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-afeb9f04-21ca-4dd8-9446-8f7f600ebd8e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:12.442225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-afeb9f04-21ca-4dd8-9446-8f7f600ebd8e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:12.460059 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afeb9f04-21ca-4dd8-9446-8f7f600ebd8e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:12.461183 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afeb9f04-21ca-4dd8-9446-8f7f600ebd8e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:12.462577 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afeb9f04-21ca-4dd8-9446-8f7f600ebd8e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:12.462917 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afeb9f04-21ca-4dd8-9446-8f7f600ebd8e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:12.651655 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afeb9f04-21ca-4dd8-9446-8f7f600ebd8e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:12.659968 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-afeb9f04-21ca-4dd8-9446-8f7f600ebd8e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.223834 Jul 12 07:22:12.660681 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 514/1018] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:12 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:13.685910 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-00a70d2d-7f09-4aa2-a208-3e0160cadb32 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:13.687423 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-00a70d2d-7f09-4aa2-a208-3e0160cadb32 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:13.702528 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00a70d2d-7f09-4aa2-a208-3e0160cadb32 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:13.704153 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00a70d2d-7f09-4aa2-a208-3e0160cadb32 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:13.706008 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00a70d2d-7f09-4aa2-a208-3e0160cadb32 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:13.707521 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-00a70d2d-7f09-4aa2-a208-3e0160cadb32 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:13.869586 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-00a70d2d-7f09-4aa2-a208-3e0160cadb32 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:13.880494 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-00a70d2d-7f09-4aa2-a208-3e0160cadb32 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.206350 Jul 12 07:22:13.882270 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 505/1019] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:13 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:22:14.898648 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2d95ea57-dc08-4d23-aa7d-8960f2a51826 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:14.899631 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2d95ea57-dc08-4d23-aa7d-8960f2a51826 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:14.906518 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d95ea57-dc08-4d23-aa7d-8960f2a51826 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:14.906986 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d95ea57-dc08-4d23-aa7d-8960f2a51826 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:14.907811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d95ea57-dc08-4d23-aa7d-8960f2a51826 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:14.908241 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d95ea57-dc08-4d23-aa7d-8960f2a51826 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:15.052260 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2d95ea57-dc08-4d23-aa7d-8960f2a51826 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:15.061183 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2d95ea57-dc08-4d23-aa7d-8960f2a51826 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.166566 Jul 12 07:22:15.071963 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 515/1020] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:14 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:16.079179 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e19024cd-a122-488e-baa0-a8c22d3a9a5c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:16.079946 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e19024cd-a122-488e-baa0-a8c22d3a9a5c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:16.088542 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e19024cd-a122-488e-baa0-a8c22d3a9a5c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:16.089467 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e19024cd-a122-488e-baa0-a8c22d3a9a5c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:16.090367 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e19024cd-a122-488e-baa0-a8c22d3a9a5c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:16.090834 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e19024cd-a122-488e-baa0-a8c22d3a9a5c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:16.259045 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-e19024cd-a122-488e-baa0-a8c22d3a9a5c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:16.267659 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e19024cd-a122-488e-baa0-a8c22d3a9a5c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.192426 Jul 12 07:22:16.268630 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 506/1021] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:16 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:22:17.286632 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9143147d-939d-46c9-a25e-6abda8906301 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:17.287373 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9143147d-939d-46c9-a25e-6abda8906301 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:17.290160 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:17.290810 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=6 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:17.296568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9143147d-939d-46c9-a25e-6abda8906301 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:17.297001 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9143147d-939d-46c9-a25e-6abda8906301 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:17.297788 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9143147d-939d-46c9-a25e-6abda8906301 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:17.298213 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9143147d-939d-46c9-a25e-6abda8906301 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:17.439576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9143147d-939d-46c9-a25e-6abda8906301 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:17.448811 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9143147d-939d-46c9-a25e-6abda8906301 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.166225 Jul 12 07:22:17.449546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 516/1022] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:17 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:18.466422 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7290299b-730f-4291-8ec3-a81c452069f5 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:18.467172 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7290299b-730f-4291-8ec3-a81c452069f5 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:18.469344 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=6 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:18.475369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7290299b-730f-4291-8ec3-a81c452069f5 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:18.475808 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7290299b-730f-4291-8ec3-a81c452069f5 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:18.476575 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7290299b-730f-4291-8ec3-a81c452069f5 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:18.477299 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7290299b-730f-4291-8ec3-a81c452069f5 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:18.621766 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7290299b-730f-4291-8ec3-a81c452069f5 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:18.629656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7290299b-730f-4291-8ec3-a81c452069f5 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.167393 Jul 12 07:22:18.630246 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 507/1023] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:18 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:19.650286 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-14355780-1793-4cf2-b931-c9d04bbd4a5d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:19.650968 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-14355780-1793-4cf2-b931-c9d04bbd4a5d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:19.657709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14355780-1793-4cf2-b931-c9d04bbd4a5d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:19.658127 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14355780-1793-4cf2-b931-c9d04bbd4a5d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:19.658907 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14355780-1793-4cf2-b931-c9d04bbd4a5d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:19.659334 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14355780-1793-4cf2-b931-c9d04bbd4a5d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:19.867281 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-14355780-1793-4cf2-b931-c9d04bbd4a5d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:19.875809 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-14355780-1793-4cf2-b931-c9d04bbd4a5d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.232057 Jul 12 07:22:19.876481 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 517/1024] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:19 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:20.893193 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fb621da9-8b68-4652-8d44-3bf45bc24f9f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:20.893799 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fb621da9-8b68-4652-8d44-3bf45bc24f9f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:20.902267 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb621da9-8b68-4652-8d44-3bf45bc24f9f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:20.902837 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb621da9-8b68-4652-8d44-3bf45bc24f9f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:20.903867 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb621da9-8b68-4652-8d44-3bf45bc24f9f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:20.904506 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fb621da9-8b68-4652-8d44-3bf45bc24f9f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:21.060202 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fb621da9-8b68-4652-8d44-3bf45bc24f9f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:21.067911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fb621da9-8b68-4652-8d44-3bf45bc24f9f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.178660 Jul 12 07:22:21.068627 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 508/1025] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:20 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:21.361472 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-9d92d28a-d29b-4ffb-bb8a-030c611d4581 req-1bf959df-7528-494a-bda0-7fa2c733e9bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847436df-06b3-44b3-99f3-6ea7898a4a08", "tag": "65e61e03-b843-4f81-a0bd-e91f48fb2530"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:22:21.371539 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-9d92d28a-d29b-4ffb-bb8a-030c611d4581 req-1bf959df-7528-494a-bda0-7fa2c733e9bb service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:21.372065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-9d92d28a-d29b-4ffb-bb8a-030c611d4581 req-1bf959df-7528-494a-bda0-7fa2c733e9bb service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:21.384694 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-9d92d28a-d29b-4ffb-bb8a-030c611d4581 req-1bf959df-7528-494a-bda0-7fa2c733e9bb service nova] Creating event network-changed:65e61e03-b843-4f81-a0bd-e91f48fb2530 for instance 847436df-06b3-44b3-99f3-6ea7898a4a08 on hv-cinder-82549 Jul 12 07:22:21.390020 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-9d92d28a-d29b-4ffb-bb8a-030c611d4581 req-1bf959df-7528-494a-bda0-7fa2c733e9bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032325 Jul 12 07:22:21.390626 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 518/1026] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:22:22.085959 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-8a048eb0-0c49-40f5-9fd3-c5725c177845 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:22.086587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-8a048eb0-0c49-40f5-9fd3-c5725c177845 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:22.093676 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a048eb0-0c49-40f5-9fd3-c5725c177845 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:22.094119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a048eb0-0c49-40f5-9fd3-c5725c177845 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:22.094882 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a048eb0-0c49-40f5-9fd3-c5725c177845 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:22.095307 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-8a048eb0-0c49-40f5-9fd3-c5725c177845 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:22.244044 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-8a048eb0-0c49-40f5-9fd3-c5725c177845 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:22.251971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-8a048eb0-0c49-40f5-9fd3-c5725c177845 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.169950 Jul 12 07:22:22.252551 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 509/1027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:22 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:23.270894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99c435ca-f2a4-415a-9b2c-d4b896e0321f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:23.271950 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-99c435ca-f2a4-415a-9b2c-d4b896e0321f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:23.279021 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99c435ca-f2a4-415a-9b2c-d4b896e0321f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:23.279541 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99c435ca-f2a4-415a-9b2c-d4b896e0321f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:23.280374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99c435ca-f2a4-415a-9b2c-d4b896e0321f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:23.281029 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99c435ca-f2a4-415a-9b2c-d4b896e0321f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:23.422356 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-99c435ca-f2a4-415a-9b2c-d4b896e0321f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:23.432196 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-99c435ca-f2a4-415a-9b2c-d4b896e0321f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.166006 Jul 12 07:22:23.434428 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 519/1028] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:23 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:24.454892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-299cb8c8-be4b-42de-8176-f844bd5dcd3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:24.455828 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-299cb8c8-be4b-42de-8176-f844bd5dcd3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:24.467393 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-299cb8c8-be4b-42de-8176-f844bd5dcd3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:24.468125 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-299cb8c8-be4b-42de-8176-f844bd5dcd3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:24.469429 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-299cb8c8-be4b-42de-8176-f844bd5dcd3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:24.470147 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-299cb8c8-be4b-42de-8176-f844bd5dcd3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:24.621803 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-299cb8c8-be4b-42de-8176-f844bd5dcd3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:24.627737 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-299cb8c8-be4b-42de-8176-f844bd5dcd3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.179346 Jul 12 07:22:24.628302 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 510/1029] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:24 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:25.213686 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-72b8c993-0d0d-4e99-a924-dae40fea60f7 req-eb9d2cae-ba68-45e1-bb78-5ae22f6b0853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847436df-06b3-44b3-99f3-6ea7898a4a08", "name": "network-vif-plugged", "status": "completed", "tag": "65e61e03-b843-4f81-a0bd-e91f48fb2530"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:22:25.222755 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-72b8c993-0d0d-4e99-a924-dae40fea60f7 req-eb9d2cae-ba68-45e1-bb78-5ae22f6b0853 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:25.223190 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-72b8c993-0d0d-4e99-a924-dae40fea60f7 req-eb9d2cae-ba68-45e1-bb78-5ae22f6b0853 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:25.234972 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-72b8c993-0d0d-4e99-a924-dae40fea60f7 req-eb9d2cae-ba68-45e1-bb78-5ae22f6b0853 service nova] Creating event network-vif-plugged:65e61e03-b843-4f81-a0bd-e91f48fb2530 for instance 847436df-06b3-44b3-99f3-6ea7898a4a08 on hv-cinder-82549 Jul 12 07:22:25.239957 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-72b8c993-0d0d-4e99-a924-dae40fea60f7 req-eb9d2cae-ba68-45e1-bb78-5ae22f6b0853 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030060 Jul 12 07:22:25.240545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 520/1030] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:22:25.645218 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-475f52c2-3ac7-4142-9246-53ad04ffd319 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:25.645800 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-475f52c2-3ac7-4142-9246-53ad04ffd319 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:25.653678 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-475f52c2-3ac7-4142-9246-53ad04ffd319 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:25.654130 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-475f52c2-3ac7-4142-9246-53ad04ffd319 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:25.654892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-475f52c2-3ac7-4142-9246-53ad04ffd319 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:25.655324 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-475f52c2-3ac7-4142-9246-53ad04ffd319 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:25.794616 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-475f52c2-3ac7-4142-9246-53ad04ffd319 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:25.803564 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-475f52c2-3ac7-4142-9246-53ad04ffd319 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1359 microversion: 2.1 time: 0.162225 Jul 12 07:22:25.804162 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 511/1031] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:25 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:26.823958 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-162ea754-e2fa-45af-85e1-95e864592e35 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:26.827521 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-162ea754-e2fa-45af-85e1-95e864592e35 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:26.836046 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-162ea754-e2fa-45af-85e1-95e864592e35 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:26.836905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-162ea754-e2fa-45af-85e1-95e864592e35 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:26.837795 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-162ea754-e2fa-45af-85e1-95e864592e35 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:26.839378 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-162ea754-e2fa-45af-85e1-95e864592e35 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:27.001579 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-162ea754-e2fa-45af-85e1-95e864592e35 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:27.013209 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-162ea754-e2fa-45af-85e1-95e864592e35 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1550 microversion: 2.1 time: 0.195543 Jul 12 07:22:27.013789 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 521/1032] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:26 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1550 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:27.030551 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b93eff8b-cbce-43a0-a04b-acb92d47845d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:27.031139 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b93eff8b-cbce-43a0-a04b-acb92d47845d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:27.038193 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b93eff8b-cbce-43a0-a04b-acb92d47845d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:27.038627 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b93eff8b-cbce-43a0-a04b-acb92d47845d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:27.039405 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b93eff8b-cbce-43a0-a04b-acb92d47845d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:27.039829 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b93eff8b-cbce-43a0-a04b-acb92d47845d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:27.197025 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b93eff8b-cbce-43a0-a04b-acb92d47845d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:27.205293 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b93eff8b-cbce-43a0-a04b-acb92d47845d tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1550 microversion: 2.1 time: 0.179164 Jul 12 07:22:27.205862 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 512/1033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:27 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1550 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:22:27.221754 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4edb27b9-42cc-4c93-ab0f-f7d8868153e9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:27.225445 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4edb27b9-42cc-4c93-ab0f-f7d8868153e9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:27.226582 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4edb27b9-42cc-4c93-ab0f-f7d8868153e9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Searching by: {'deleted': False, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae'} {{(pid=117997) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 07:22:27.233414 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4edb27b9-42cc-4c93-ab0f-f7d8868153e9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:27.233849 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4edb27b9-42cc-4c93-ab0f-f7d8868153e9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:27.234680 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4edb27b9-42cc-4c93-ab0f-f7d8868153e9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:27.235107 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4edb27b9-42cc-4c93-ab0f-f7d8868153e9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:27.498150 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.multi_cell_list [None req-4edb27b9-42cc-4c93-ab0f-f7d8868153e9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117997) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 07:22:27.595235 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4edb27b9-42cc-4c93-ab0f-f7d8868153e9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.377575 Jul 12 07:22:27.595822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 522/1034] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 12 07:22:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:22:27.610511 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7af3f481-b861-47a0-abb7-374d6187357f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:27.611117 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7af3f481-b861-47a0-abb7-374d6187357f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:27.618517 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7af3f481-b861-47a0-abb7-374d6187357f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:27.619289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7af3f481-b861-47a0-abb7-374d6187357f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:27.620638 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7af3f481-b861-47a0-abb7-374d6187357f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:27.621396 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7af3f481-b861-47a0-abb7-374d6187357f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:27.772239 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-7af3f481-b861-47a0-abb7-374d6187357f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:27.782902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7af3f481-b861-47a0-abb7-374d6187357f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1550 microversion: 2.1 time: 0.177123 Jul 12 07:22:27.783486 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 513/1035] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:27 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1550 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:29.363730 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e3450aff-d12b-4ae1-be9a-b89c66d2b9ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6faf4a1b-e595-49dd-a249-26759a379d5c"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:22:29.364801 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3450aff-d12b-4ae1-be9a-b89c66d2b9ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:29.371449 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3450aff-d12b-4ae1-be9a-b89c66d2b9ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:29.371890 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3450aff-d12b-4ae1-be9a-b89c66d2b9ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:29.372640 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3450aff-d12b-4ae1-be9a-b89c66d2b9ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:29.373096 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3450aff-d12b-4ae1-be9a-b89c66d2b9ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:29.651000 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e3450aff-d12b-4ae1-be9a-b89c66d2b9ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "POST /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291236 Jul 12 07:22:29.651720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 523/1036] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 07:22:29 2022] POST /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:22:37.227418 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-23008fab-4ea2-4aa3-9c6b-e0f2f5338d01 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:37.228029 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-23008fab-4ea2-4aa3-9c6b-e0f2f5338d01 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:37.230624 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:37.236084 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23008fab-4ea2-4aa3-9c6b-e0f2f5338d01 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:37.236569 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23008fab-4ea2-4aa3-9c6b-e0f2f5338d01 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:37.237390 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23008fab-4ea2-4aa3-9c6b-e0f2f5338d01 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:37.237891 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-23008fab-4ea2-4aa3-9c6b-e0f2f5338d01 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:37.387145 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-23008fab-4ea2-4aa3-9c6b-e0f2f5338d01 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:37.395659 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-23008fab-4ea2-4aa3-9c6b-e0f2f5338d01 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1596 microversion: 2.1 time: 0.172295 Jul 12 07:22:37.396224 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 514/1037] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:37 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1596 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:39.289949 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-3fd4ae5c-4bc9-4be7-9070-e665ea72b08c req-0457f30b-b929-40ab-a0b0-bf86c6d329c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847436df-06b3-44b3-99f3-6ea7898a4a08", "tag": "65e61e03-b843-4f81-a0bd-e91f48fb2530"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:22:39.298329 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:39.300080 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:39.302024 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-3fd4ae5c-4bc9-4be7-9070-e665ea72b08c req-0457f30b-b929-40ab-a0b0-bf86c6d329c8 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:39.302406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-3fd4ae5c-4bc9-4be7-9070-e665ea72b08c req-0457f30b-b929-40ab-a0b0-bf86c6d329c8 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:39.307335 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:39.318289 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-3fd4ae5c-4bc9-4be7-9070-e665ea72b08c req-0457f30b-b929-40ab-a0b0-bf86c6d329c8 service nova] Creating event network-changed:65e61e03-b843-4f81-a0bd-e91f48fb2530 for instance 847436df-06b3-44b3-99f3-6ea7898a4a08 on hv-cinder-82549 Jul 12 07:22:39.324218 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-3fd4ae5c-4bc9-4be7-9070-e665ea72b08c req-0457f30b-b929-40ab-a0b0-bf86c6d329c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038120 Jul 12 07:22:39.325089 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 524/1038] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:22:40.223785 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-e0f68721-31f3-4b1e-ac05-908ae2b19861 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-995864408"}} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:22:40.224414 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-e0f68721-31f3-4b1e-ac05-908ae2b19861 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:40.231529 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0f68721-31f3-4b1e-ac05-908ae2b19861 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:40.232059 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0f68721-31f3-4b1e-ac05-908ae2b19861 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:40.232894 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0f68721-31f3-4b1e-ac05-908ae2b19861 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:40.233422 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-e0f68721-31f3-4b1e-ac05-908ae2b19861 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:40.372293 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.network.security_group_api [None req-e0f68721-31f3-4b1e-ac05-908ae2b19861 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Adding security group fa6e8b73-08df-492e-873c-0f52d4104798 to port 65e61e03-b843-4f81-a0bd-e91f48fb2530 Jul 12 07:22:40.987856 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-e0f68721-31f3-4b1e-ac05-908ae2b19861 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "POST /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/action" status: 202 len: 0 microversion: 2.1 time: 0.768540 Jul 12 07:22:40.990119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 515/1039] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:22:40 2022] POST /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:22:41.002542 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c09a0879-8f5a-48ad-a86e-ca2a588e3171 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:22:41.003235 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c09a0879-8f5a-48ad-a86e-ca2a588e3171 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:22:41.010276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c09a0879-8f5a-48ad-a86e-ca2a588e3171 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:41.010699 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c09a0879-8f5a-48ad-a86e-ca2a588e3171 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:41.012263 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c09a0879-8f5a-48ad-a86e-ca2a588e3171 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:41.012866 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c09a0879-8f5a-48ad-a86e-ca2a588e3171 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:41.164198 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c09a0879-8f5a-48ad-a86e-ca2a588e3171 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:22:41.172428 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c09a0879-8f5a-48ad-a86e-ca2a588e3171 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1642 microversion: 2.1 time: 0.177773 Jul 12 07:22:41.172993 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 525/1040] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:22:40 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1642 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:22:41.339205 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-bbe075c6-3ed9-439d-9ecc-b2dbc076dd6f req-a0444462-d3d3-40e5-9b04-392cc13afcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847436df-06b3-44b3-99f3-6ea7898a4a08", "tag": "65e61e03-b843-4f81-a0bd-e91f48fb2530"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:22:41.348183 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-bbe075c6-3ed9-439d-9ecc-b2dbc076dd6f req-a0444462-d3d3-40e5-9b04-392cc13afcb1 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:22:41.348607 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-bbe075c6-3ed9-439d-9ecc-b2dbc076dd6f req-a0444462-d3d3-40e5-9b04-392cc13afcb1 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:22:41.360371 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-bbe075c6-3ed9-439d-9ecc-b2dbc076dd6f req-a0444462-d3d3-40e5-9b04-392cc13afcb1 service nova] Creating event network-changed:65e61e03-b843-4f81-a0bd-e91f48fb2530 for instance 847436df-06b3-44b3-99f3-6ea7898a4a08 on hv-cinder-82549 Jul 12 07:22:41.365951 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-bbe075c6-3ed9-439d-9ecc-b2dbc076dd6f req-a0444462-d3d3-40e5-9b04-392cc13afcb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030896 Jul 12 07:22:41.366539 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 516/1041] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:23:04.690256 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:23:04.690859 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Tue Jul 12 07:23:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:23:13.090864 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-60f1f052-566d-4510-bea9-e611175e9a86 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:23:13.092471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-60f1f052-566d-4510-bea9-e611175e9a86 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:13.096702 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:23:13.097809 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=7 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:23:13.110150 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60f1f052-566d-4510-bea9-e611175e9a86 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:13.110648 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60f1f052-566d-4510-bea9-e611175e9a86 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:13.111419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60f1f052-566d-4510-bea9-e611175e9a86 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:13.111857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60f1f052-566d-4510-bea9-e611175e9a86 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:13.202311 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-60f1f052-566d-4510-bea9-e611175e9a86 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "POST /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/action" status: 202 len: 0 microversion: 2.1 time: 0.117572 Jul 12 07:23:13.203261 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 526/1042] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:23:13 2022] POST /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:23:13.210101 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=5 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:23:13.210844 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=71 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:23:13.214865 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-129f208f-4a01-4354-ba74-1a228dad8780 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:13.215584 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-129f208f-4a01-4354-ba74-1a228dad8780 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:13.223240 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-129f208f-4a01-4354-ba74-1a228dad8780 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:13.223701 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-129f208f-4a01-4354-ba74-1a228dad8780 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:13.224461 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-129f208f-4a01-4354-ba74-1a228dad8780 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:13.224903 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-129f208f-4a01-4354-ba74-1a228dad8780 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:13.554312 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-129f208f-4a01-4354-ba74-1a228dad8780 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:13.562522 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-129f208f-4a01-4354-ba74-1a228dad8780 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1753 microversion: 2.1 time: 0.354014 Jul 12 07:23:13.563107 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 517/1043] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:13 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1753 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:14.586330 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ff9bfd00-163d-4d23-b2e6-f3f41e38af84 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:14.587484 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ff9bfd00-163d-4d23-b2e6-f3f41e38af84 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:14.597765 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff9bfd00-163d-4d23-b2e6-f3f41e38af84 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:14.598217 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff9bfd00-163d-4d23-b2e6-f3f41e38af84 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:14.598972 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff9bfd00-163d-4d23-b2e6-f3f41e38af84 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:14.599403 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff9bfd00-163d-4d23-b2e6-f3f41e38af84 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:14.827018 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ff9bfd00-163d-4d23-b2e6-f3f41e38af84 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:14.840518 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ff9bfd00-163d-4d23-b2e6-f3f41e38af84 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.261785 Jul 12 07:23:14.841301 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 527/1044] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:14 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:15.865043 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-c5edf2f4-224e-4b25-b2cb-bb8389d418b6 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:15.865900 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-c5edf2f4-224e-4b25-b2cb-bb8389d418b6 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:15.874701 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c5edf2f4-224e-4b25-b2cb-bb8389d418b6 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:15.875289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c5edf2f4-224e-4b25-b2cb-bb8389d418b6 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:15.876309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c5edf2f4-224e-4b25-b2cb-bb8389d418b6 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:15.876879 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-c5edf2f4-224e-4b25-b2cb-bb8389d418b6 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:16.035249 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-c5edf2f4-224e-4b25-b2cb-bb8389d418b6 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:16.043601 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-c5edf2f4-224e-4b25-b2cb-bb8389d418b6 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.185661 Jul 12 07:23:16.044176 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 518/1045] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:15 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:17.063441 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-675027d0-8bb2-47b8-b0fd-19e66914d52e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:17.064173 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-675027d0-8bb2-47b8-b0fd-19e66914d52e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:17.071614 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-675027d0-8bb2-47b8-b0fd-19e66914d52e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:17.072086 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-675027d0-8bb2-47b8-b0fd-19e66914d52e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:17.072833 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-675027d0-8bb2-47b8-b0fd-19e66914d52e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:17.073300 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-675027d0-8bb2-47b8-b0fd-19e66914d52e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:17.219568 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-675027d0-8bb2-47b8-b0fd-19e66914d52e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:17.232166 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-675027d0-8bb2-47b8-b0fd-19e66914d52e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.173663 Jul 12 07:23:17.233118 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 528/1046] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:17 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:18.255630 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d8a64b53-a1ca-4e53-9d98-7ec9bceb5704 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:18.256258 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d8a64b53-a1ca-4e53-9d98-7ec9bceb5704 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:18.263588 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8a64b53-a1ca-4e53-9d98-7ec9bceb5704 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:18.264080 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8a64b53-a1ca-4e53-9d98-7ec9bceb5704 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:18.264921 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8a64b53-a1ca-4e53-9d98-7ec9bceb5704 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:18.265437 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d8a64b53-a1ca-4e53-9d98-7ec9bceb5704 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:18.442513 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d8a64b53-a1ca-4e53-9d98-7ec9bceb5704 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:18.450984 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d8a64b53-a1ca-4e53-9d98-7ec9bceb5704 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.201790 Jul 12 07:23:18.451564 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 519/1047] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:18 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:19.471979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fa1ee186-a90e-4150-bdc8-005282a7bc68 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:19.474793 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fa1ee186-a90e-4150-bdc8-005282a7bc68 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:19.483763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa1ee186-a90e-4150-bdc8-005282a7bc68 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:19.484498 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa1ee186-a90e-4150-bdc8-005282a7bc68 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:19.485790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa1ee186-a90e-4150-bdc8-005282a7bc68 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:19.486495 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa1ee186-a90e-4150-bdc8-005282a7bc68 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:19.657401 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fa1ee186-a90e-4150-bdc8-005282a7bc68 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:19.669606 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fa1ee186-a90e-4150-bdc8-005282a7bc68 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.203974 Jul 12 07:23:19.670519 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 529/1048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:19 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:20.693491 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-358c6f9e-8b08-4a46-8130-9e183a1d1ea8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:20.694151 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-358c6f9e-8b08-4a46-8130-9e183a1d1ea8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:20.701369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-358c6f9e-8b08-4a46-8130-9e183a1d1ea8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:20.701829 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-358c6f9e-8b08-4a46-8130-9e183a1d1ea8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:20.702619 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-358c6f9e-8b08-4a46-8130-9e183a1d1ea8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:20.703068 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-358c6f9e-8b08-4a46-8130-9e183a1d1ea8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:20.859367 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-358c6f9e-8b08-4a46-8130-9e183a1d1ea8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:20.869974 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-358c6f9e-8b08-4a46-8130-9e183a1d1ea8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.182720 Jul 12 07:23:20.870617 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 520/1049] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:20 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:21.887770 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a5831540-63f6-432a-9c0f-9be43b6c21ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:21.888341 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a5831540-63f6-432a-9c0f-9be43b6c21ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:21.895819 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5831540-63f6-432a-9c0f-9be43b6c21ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:21.896531 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5831540-63f6-432a-9c0f-9be43b6c21ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:21.897338 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5831540-63f6-432a-9c0f-9be43b6c21ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:21.897771 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5831540-63f6-432a-9c0f-9be43b6c21ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:22.046916 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a5831540-63f6-432a-9c0f-9be43b6c21ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:22.055355 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a5831540-63f6-432a-9c0f-9be43b6c21ee tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.171813 Jul 12 07:23:22.055927 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 530/1050] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:21 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:23.076976 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4d4284fd-732b-491c-82b9-03085dca4545 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:23.077997 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4d4284fd-732b-491c-82b9-03085dca4545 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:23.087076 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d4284fd-732b-491c-82b9-03085dca4545 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:23.087528 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d4284fd-732b-491c-82b9-03085dca4545 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:23.088316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d4284fd-732b-491c-82b9-03085dca4545 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:23.088755 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4d4284fd-732b-491c-82b9-03085dca4545 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:23.253812 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4d4284fd-732b-491c-82b9-03085dca4545 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:23.262397 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4d4284fd-732b-491c-82b9-03085dca4545 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.191887 Jul 12 07:23:23.263007 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 521/1051] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:23 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:24.284593 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-14ae4116-9729-4dcc-8dd2-b1b42e409860 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:24.285561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-14ae4116-9729-4dcc-8dd2-b1b42e409860 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:24.296763 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14ae4116-9729-4dcc-8dd2-b1b42e409860 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:24.297566 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14ae4116-9729-4dcc-8dd2-b1b42e409860 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:24.298806 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14ae4116-9729-4dcc-8dd2-b1b42e409860 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:24.299513 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14ae4116-9729-4dcc-8dd2-b1b42e409860 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:24.456088 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-14ae4116-9729-4dcc-8dd2-b1b42e409860 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:24.465580 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-14ae4116-9729-4dcc-8dd2-b1b42e409860 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.187451 Jul 12 07:23:24.466116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 531/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:24 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:25.486777 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-3ec2454f-8a8a-4965-8001-99746eebc5ed tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:25.487695 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-3ec2454f-8a8a-4965-8001-99746eebc5ed tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:25.498818 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ec2454f-8a8a-4965-8001-99746eebc5ed tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:25.499549 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ec2454f-8a8a-4965-8001-99746eebc5ed tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:25.500784 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ec2454f-8a8a-4965-8001-99746eebc5ed tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:25.501552 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-3ec2454f-8a8a-4965-8001-99746eebc5ed tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:25.656346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-3ec2454f-8a8a-4965-8001-99746eebc5ed tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:25.668006 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-3ec2454f-8a8a-4965-8001-99746eebc5ed tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.187665 Jul 12 07:23:25.668817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 522/1053] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:25 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:26.694605 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d5fe70fc-cc77-49e1-9ce1-ac2c8bb605c4 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:26.695535 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d5fe70fc-cc77-49e1-9ce1-ac2c8bb605c4 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:26.706880 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5fe70fc-cc77-49e1-9ce1-ac2c8bb605c4 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:26.707617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5fe70fc-cc77-49e1-9ce1-ac2c8bb605c4 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:26.708942 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5fe70fc-cc77-49e1-9ce1-ac2c8bb605c4 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:26.709412 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5fe70fc-cc77-49e1-9ce1-ac2c8bb605c4 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:26.854796 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d5fe70fc-cc77-49e1-9ce1-ac2c8bb605c4 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:26.867414 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d5fe70fc-cc77-49e1-9ce1-ac2c8bb605c4 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.179232 Jul 12 07:23:26.868371 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 532/1054] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:26 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:27.891662 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-68586987-7faa-436b-8f72-3a5b06737ce9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:27.892309 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-68586987-7faa-436b-8f72-3a5b06737ce9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:27.899690 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-68586987-7faa-436b-8f72-3a5b06737ce9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:27.900134 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-68586987-7faa-436b-8f72-3a5b06737ce9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:27.900902 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-68586987-7faa-436b-8f72-3a5b06737ce9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:27.901364 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-68586987-7faa-436b-8f72-3a5b06737ce9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:28.088231 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-68586987-7faa-436b-8f72-3a5b06737ce9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:28.103821 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-68586987-7faa-436b-8f72-3a5b06737ce9 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.217602 Jul 12 07:23:28.104601 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 523/1055] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:27 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:29.133722 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0cb86a8f-c374-460d-8b08-a0c9251e5fb0 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:29.134448 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0cb86a8f-c374-460d-8b08-a0c9251e5fb0 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:29.143055 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cb86a8f-c374-460d-8b08-a0c9251e5fb0 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:29.143604 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cb86a8f-c374-460d-8b08-a0c9251e5fb0 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:29.144540 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cb86a8f-c374-460d-8b08-a0c9251e5fb0 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:29.145095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cb86a8f-c374-460d-8b08-a0c9251e5fb0 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:29.309662 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0cb86a8f-c374-460d-8b08-a0c9251e5fb0 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:29.324178 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0cb86a8f-c374-460d-8b08-a0c9251e5fb0 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.196172 Jul 12 07:23:29.324742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 533/1056] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:29 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:30.347921 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-83ad72f5-b654-474c-9743-b7884e21d7ad tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:30.348888 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-83ad72f5-b654-474c-9743-b7884e21d7ad tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:30.361093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83ad72f5-b654-474c-9743-b7884e21d7ad tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:30.361869 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83ad72f5-b654-474c-9743-b7884e21d7ad tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:30.363086 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83ad72f5-b654-474c-9743-b7884e21d7ad tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:30.363792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-83ad72f5-b654-474c-9743-b7884e21d7ad tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:30.528971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-83ad72f5-b654-474c-9743-b7884e21d7ad tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:30.540271 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-83ad72f5-b654-474c-9743-b7884e21d7ad tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.199025 Jul 12 07:23:30.540816 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 524/1057] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:30 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:31.567649 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-912c067d-1151-451d-8e18-e60d4e2d1ca1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:31.568545 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-912c067d-1151-451d-8e18-e60d4e2d1ca1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:31.577235 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-912c067d-1151-451d-8e18-e60d4e2d1ca1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:31.577687 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-912c067d-1151-451d-8e18-e60d4e2d1ca1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:31.578441 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-912c067d-1151-451d-8e18-e60d4e2d1ca1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:31.578873 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-912c067d-1151-451d-8e18-e60d4e2d1ca1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:31.733471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-912c067d-1151-451d-8e18-e60d4e2d1ca1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:31.744826 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-912c067d-1151-451d-8e18-e60d4e2d1ca1 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.183855 Jul 12 07:23:31.745419 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 534/1058] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:31 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:32.765952 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2f630277-5d8c-46f2-9834-88dfe0a97d18 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:32.766892 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2f630277-5d8c-46f2-9834-88dfe0a97d18 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:32.778657 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2f630277-5d8c-46f2-9834-88dfe0a97d18 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:32.779410 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2f630277-5d8c-46f2-9834-88dfe0a97d18 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:32.780671 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2f630277-5d8c-46f2-9834-88dfe0a97d18 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:32.781477 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2f630277-5d8c-46f2-9834-88dfe0a97d18 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:32.937128 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-2f630277-5d8c-46f2-9834-88dfe0a97d18 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:32.948650 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2f630277-5d8c-46f2-9834-88dfe0a97d18 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.189269 Jul 12 07:23:32.949265 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 525/1059] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:32 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:33.970469 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-969bbec1-a3b6-4a4b-b48e-866a0497f577 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:33.971391 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-969bbec1-a3b6-4a4b-b48e-866a0497f577 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:33.982858 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-969bbec1-a3b6-4a4b-b48e-866a0497f577 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:33.983599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-969bbec1-a3b6-4a4b-b48e-866a0497f577 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:33.984836 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-969bbec1-a3b6-4a4b-b48e-866a0497f577 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:33.985590 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-969bbec1-a3b6-4a4b-b48e-866a0497f577 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:34.137596 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-969bbec1-a3b6-4a4b-b48e-866a0497f577 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:34.145801 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-969bbec1-a3b6-4a4b-b48e-866a0497f577 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.181873 Jul 12 07:23:34.146340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 535/1060] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:33 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:35.166840 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-d236016a-6ec2-4d80-8af7-70586920e32f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:35.167540 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-d236016a-6ec2-4d80-8af7-70586920e32f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:35.175909 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d236016a-6ec2-4d80-8af7-70586920e32f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:35.176433 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d236016a-6ec2-4d80-8af7-70586920e32f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:35.177375 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d236016a-6ec2-4d80-8af7-70586920e32f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:35.177893 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-d236016a-6ec2-4d80-8af7-70586920e32f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:35.338020 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-d236016a-6ec2-4d80-8af7-70586920e32f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:35.346802 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-d236016a-6ec2-4d80-8af7-70586920e32f tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1758 microversion: 2.1 time: 0.186113 Jul 12 07:23:35.347434 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 526/1061] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:35 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:23:36.368704 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd2ad50d-68f6-42c9-a08a-7536f405b2da tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:23:36.369451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd2ad50d-68f6-42c9-a08a-7536f405b2da tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:23:36.376427 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd2ad50d-68f6-42c9-a08a-7536f405b2da tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:36.376902 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd2ad50d-68f6-42c9-a08a-7536f405b2da tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:36.377671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd2ad50d-68f6-42c9-a08a-7536f405b2da tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:23:36.378099 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd2ad50d-68f6-42c9-a08a-7536f405b2da tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:23:36.526065 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd2ad50d-68f6-42c9-a08a-7536f405b2da tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:23:36.538317 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd2ad50d-68f6-42c9-a08a-7536f405b2da tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1761 microversion: 2.1 time: 0.175757 Jul 12 07:23:36.539050 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 536/1062] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:23:36 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1761 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:03.038787 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-7a2a2fa2-7466-4df1-af60-f31710b142fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:03.039388 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7a2a2fa2-7466-4df1-af60-f31710b142fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:03.041380 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=20 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:03.042040 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=60 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:03.047749 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a2a2fa2-7466-4df1-af60-f31710b142fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:03.048189 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a2a2fa2-7466-4df1-af60-f31710b142fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:03.048948 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a2a2fa2-7466-4df1-af60-f31710b142fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:03.049403 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-7a2a2fa2-7466-4df1-af60-f31710b142fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:03.074670 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-7a2a2fa2-7466-4df1-af60-f31710b142fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:24:03.154915 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-7a2a2fa2-7466-4df1-af60-f31710b142fb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 204 len: 0 microversion: 2.1 time: 0.120468 Jul 12 07:24:03.155465 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 527/1063] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:24:03 2022] DELETE /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:24:03.164010 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d328d398-1223-4b99-a4ef-bd928c8df098 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:03.164612 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d328d398-1223-4b99-a4ef-bd928c8df098 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:03.166815 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=22 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:03.167460 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:03.174599 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d328d398-1223-4b99-a4ef-bd928c8df098 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:03.175406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d328d398-1223-4b99-a4ef-bd928c8df098 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:03.176180 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d328d398-1223-4b99-a4ef-bd928c8df098 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:03.176611 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d328d398-1223-4b99-a4ef-bd928c8df098 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:03.316729 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d328d398-1223-4b99-a4ef-bd928c8df098 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:03.324659 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d328d398-1223-4b99-a4ef-bd928c8df098 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1577 microversion: 2.1 time: 0.164717 Jul 12 07:24:03.325228 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 537/1064] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:03 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:04.348342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f93dbe2b-bba7-45e1-9578-f8248d79eaff tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:04.349583 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f93dbe2b-bba7-45e1-9578-f8248d79eaff tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:04.360787 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f93dbe2b-bba7-45e1-9578-f8248d79eaff tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:04.361587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f93dbe2b-bba7-45e1-9578-f8248d79eaff tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:04.363062 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f93dbe2b-bba7-45e1-9578-f8248d79eaff tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:04.363622 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f93dbe2b-bba7-45e1-9578-f8248d79eaff tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:04.505773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f93dbe2b-bba7-45e1-9578-f8248d79eaff tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:04.513656 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f93dbe2b-bba7-45e1-9578-f8248d79eaff tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1577 microversion: 2.1 time: 0.173335 Jul 12 07:24:04.514234 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 528/1065] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:04 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:05.531924 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e9a4ab6-acf2-4f1b-9c23-53d2b8ef2dc2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:05.532525 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e9a4ab6-acf2-4f1b-9c23-53d2b8ef2dc2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:05.539988 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e9a4ab6-acf2-4f1b-9c23-53d2b8ef2dc2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:05.540447 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e9a4ab6-acf2-4f1b-9c23-53d2b8ef2dc2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:05.541620 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e9a4ab6-acf2-4f1b-9c23-53d2b8ef2dc2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:05.541620 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e9a4ab6-acf2-4f1b-9c23-53d2b8ef2dc2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:05.743016 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7e9a4ab6-acf2-4f1b-9c23-53d2b8ef2dc2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:05.750746 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e9a4ab6-acf2-4f1b-9c23-53d2b8ef2dc2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1577 microversion: 2.1 time: 0.222868 Jul 12 07:24:05.751550 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 538/1066] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:05 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:06.141541 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-b15a5876-8971-46d0-ac3d-07fc208ce8ab req-75db661c-156b-47cc-8daf-de3edb0c97db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3776b5e2-d4ea-4709-9f38-44945b6ff3f3", "name": "network-vif-deleted", "tag": "dfa4e3d1-b3f0-43a9-b856-0e0a60dc1a3e"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:24:06.159711 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-b15a5876-8971-46d0-ac3d-07fc208ce8ab req-75db661c-156b-47cc-8daf-de3edb0c97db service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:06.160587 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-b15a5876-8971-46d0-ac3d-07fc208ce8ab req-75db661c-156b-47cc-8daf-de3edb0c97db service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:06.177874 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-b15a5876-8971-46d0-ac3d-07fc208ce8ab req-75db661c-156b-47cc-8daf-de3edb0c97db service nova] Creating event network-vif-deleted:dfa4e3d1-b3f0-43a9-b856-0e0a60dc1a3e for instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 on hv-cinder-82549 Jul 12 07:24:06.184590 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-b15a5876-8971-46d0-ac3d-07fc208ce8ab req-75db661c-156b-47cc-8daf-de3edb0c97db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113008 Jul 12 07:24:06.185971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 529/1067] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:24:06.768131 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:06.768743 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:06.776040 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:06.776477 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:06.777277 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:06.777706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:06.809792 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:06.810232 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:06.810674 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lazy-loading 'fault' on Instance uuid 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:24:06.856275 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:06.864612 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-85fd3ada-153e-43f9-9174-38251246ea9d tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 200 len: 1229 microversion: 2.1 time: 0.100337 Jul 12 07:24:06.875269 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 539/1068] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:06 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:07.886920 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:07.887558 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:07.894742 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:07.895186 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:07.895954 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:07.896382 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:07.910449 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] HTTP exception thrown: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Request method failure captured: Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 HTTP/1.1 Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizSDQmrgkmtX7eorMogWXZkLrZuvlY928hlxPEqjaMHTQmUvvrZyuaWsX82yxQC2gNGTh5SS-NZo8mOtj5xDgc4iCmWqtREPyuy5W9JCvDx0V_cND854upHr3qtCowxGMJ64AgRToJQq4XWWGtF_x5LK6cdUrYLZDxSbOS4kqTOI2jCI Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:24:07.912105 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/883812495f3940a3bdeff8d4c08a29c3"}]}] Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 5279c7bf349746b4a4622f72945662ea Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:24:07.913780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '3776b5e2-d4ea-4709-9f38-44945b6ff3f3'} Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:24:07.914796 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:24:07.916159 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:07.917471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Returning 404 to user: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:24:07.917471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-2047f201-9d14-4936-a06c-55b109f878eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 404 len: 111 microversion: 2.1 time: 0.033819 Jul 12 07:24:07.917471 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 530/1069] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:07 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:24:08.016738 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-760968110", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1485749986", "security_groups": [{"name": "tempest-secgroup-smoke-1734143131"}], "block_device_mapping_v2": [{"uuid": "c7b4541d-c045-463d-aa2e-679e4cc0eb86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e1f0417e-f44e-4fb0-a137-3bcf769956d0"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:24:08.149079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] validate_networks() for [('e1f0417e-f44e-4fb0-a137-3bcf769956d0', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:24:08.572406 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:24:08.572828 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:24:08.573340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:24:08.573742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:24:08.574149 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:24:08.584210 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:08.584645 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:08.585470 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:08.585888 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:08.603675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Getting quotas for project 883812495f3940a3bdeff8d4c08a29c3. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:24:08.608366 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Getting quotas for user 5279c7bf349746b4a4622f72945662ea and project 883812495f3940a3bdeff8d4c08a29c3. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:24:08.668240 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:24:08.670384 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7b4541d-c045-463d-aa2e-679e4cc0eb86',volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:24:08.809964 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-778160e2-7056-468a-97b2-abb3785abf36 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.797074 Jul 12 07:24:08.810618 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 540/1070] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:24:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:24:08.820750 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a2d85f5a-cb20-4fc3-98c7-597839e0d20c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:08.821386 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a2d85f5a-cb20-4fc3-98c7-597839e0d20c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:08.877797 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a2d85f5a-cb20-4fc3-98c7-597839e0d20c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:08.885295 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a2d85f5a-cb20-4fc3-98c7-597839e0d20c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1094 microversion: 2.1 time: 0.068496 Jul 12 07:24:08.885865 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 531/1071] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:08 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:09.904759 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ee3560de-44e7-4e95-b916-0ff3cf81e545 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:09.905401 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ee3560de-44e7-4e95-b916-0ff3cf81e545 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:09.911901 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee3560de-44e7-4e95-b916-0ff3cf81e545 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:09.912376 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee3560de-44e7-4e95-b916-0ff3cf81e545 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:09.913171 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee3560de-44e7-4e95-b916-0ff3cf81e545 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:09.913619 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee3560de-44e7-4e95-b916-0ff3cf81e545 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:09.976969 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ee3560de-44e7-4e95-b916-0ff3cf81e545 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:09.985843 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ee3560de-44e7-4e95-b916-0ff3cf81e545 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1192 microversion: 2.1 time: 0.086735 Jul 12 07:24:09.986634 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 541/1072] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:09 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:11.003114 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9336bc66-3285-40c7-9903-c9af3b161eab tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:11.003675 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9336bc66-3285-40c7-9903-c9af3b161eab tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:11.011773 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9336bc66-3285-40c7-9903-c9af3b161eab tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:11.012211 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9336bc66-3285-40c7-9903-c9af3b161eab tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:11.012974 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9336bc66-3285-40c7-9903-c9af3b161eab tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:11.013443 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9336bc66-3285-40c7-9903-c9af3b161eab tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:11.213804 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-9336bc66-3285-40c7-9903-c9af3b161eab tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:11.221379 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9336bc66-3285-40c7-9903-c9af3b161eab tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.222200 Jul 12 07:24:11.221983 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 532/1073] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:10 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:11.481276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-a8d615a7-fc2b-4080-9cbd-a63ddfe2a772 req-18f2f490-a4ac-48b8-a394-c951da9d507d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d2c727-3181-42c2-a071-fa7eec04b391", "tag": "790fc29e-5907-4b44-bcfc-4b171e467d88"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:24:11.507932 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-a8d615a7-fc2b-4080-9cbd-a63ddfe2a772 req-18f2f490-a4ac-48b8-a394-c951da9d507d service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:11.508374 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-a8d615a7-fc2b-4080-9cbd-a63ddfe2a772 req-18f2f490-a4ac-48b8-a394-c951da9d507d service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:11.520502 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-a8d615a7-fc2b-4080-9cbd-a63ddfe2a772 req-18f2f490-a4ac-48b8-a394-c951da9d507d service nova] Creating event network-changed:790fc29e-5907-4b44-bcfc-4b171e467d88 for instance f0d2c727-3181-42c2-a071-fa7eec04b391 on hv-cinder-82549 Jul 12 07:24:11.526238 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-a8d615a7-fc2b-4080-9cbd-a63ddfe2a772 req-18f2f490-a4ac-48b8-a394-c951da9d507d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048830 Jul 12 07:24:11.527067 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 542/1074] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:24:12.238971 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-18d9e8e7-9ba0-45f8-ae18-9a0b0f71b54e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:12.239630 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-18d9e8e7-9ba0-45f8-ae18-9a0b0f71b54e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:12.246661 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18d9e8e7-9ba0-45f8-ae18-9a0b0f71b54e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:12.247098 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18d9e8e7-9ba0-45f8-ae18-9a0b0f71b54e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:12.247920 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18d9e8e7-9ba0-45f8-ae18-9a0b0f71b54e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:12.248286 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-18d9e8e7-9ba0-45f8-ae18-9a0b0f71b54e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:12.384781 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-18d9e8e7-9ba0-45f8-ae18-9a0b0f71b54e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:12.395881 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-18d9e8e7-9ba0-45f8-ae18-9a0b0f71b54e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.160925 Jul 12 07:24:12.396429 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 533/1075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:12 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:13.419675 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0aa3bfd1-904a-4637-bf62-23dd7dad4dd3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:13.420636 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0aa3bfd1-904a-4637-bf62-23dd7dad4dd3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:13.431225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0aa3bfd1-904a-4637-bf62-23dd7dad4dd3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:13.431905 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0aa3bfd1-904a-4637-bf62-23dd7dad4dd3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:13.433184 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0aa3bfd1-904a-4637-bf62-23dd7dad4dd3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:13.433890 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0aa3bfd1-904a-4637-bf62-23dd7dad4dd3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:13.572607 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0aa3bfd1-904a-4637-bf62-23dd7dad4dd3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:13.580734 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0aa3bfd1-904a-4637-bf62-23dd7dad4dd3 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.169111 Jul 12 07:24:13.581342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 543/1076] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:13 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:14.602009 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a7b1fe98-46fc-42b0-bdeb-9546a9b32976 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:14.602950 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a7b1fe98-46fc-42b0-bdeb-9546a9b32976 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:14.614348 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7b1fe98-46fc-42b0-bdeb-9546a9b32976 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:14.615231 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7b1fe98-46fc-42b0-bdeb-9546a9b32976 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:14.616007 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7b1fe98-46fc-42b0-bdeb-9546a9b32976 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:14.616444 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a7b1fe98-46fc-42b0-bdeb-9546a9b32976 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:14.767507 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a7b1fe98-46fc-42b0-bdeb-9546a9b32976 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:14.775752 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a7b1fe98-46fc-42b0-bdeb-9546a9b32976 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.180310 Jul 12 07:24:14.776349 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 534/1077] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:14 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:15.182005 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-79d28c9e-c3b5-4e94-9826-519f7dc2d573 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-995864408"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:24:15.182933 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-79d28c9e-c3b5-4e94-9826-519f7dc2d573 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:15.193760 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79d28c9e-c3b5-4e94-9826-519f7dc2d573 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:15.194197 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79d28c9e-c3b5-4e94-9826-519f7dc2d573 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:15.194945 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79d28c9e-c3b5-4e94-9826-519f7dc2d573 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:15.195365 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79d28c9e-c3b5-4e94-9826-519f7dc2d573 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:15.327775 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.network.security_group_api [None req-79d28c9e-c3b5-4e94-9826-519f7dc2d573 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Removing security group fa6e8b73-08df-492e-873c-0f52d4104798 from port 65e61e03-b843-4f81-a0bd-e91f48fb2530 Jul 12 07:24:15.692314 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-79d28c9e-c3b5-4e94-9826-519f7dc2d573 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "POST /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/action" status: 202 len: 0 microversion: 2.1 time: 0.517179 Jul 12 07:24:15.696650 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 544/1078] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 07:24:15 2022] POST /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:24:15.704049 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-39fa784e-f148-41a0-a8b9-d8e35891429c req-15b1b7f5-f4e5-4055-b696-218b6a1bf1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847436df-06b3-44b3-99f3-6ea7898a4a08", "tag": "65e61e03-b843-4f81-a0bd-e91f48fb2530"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:24:15.721633 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-39fa784e-f148-41a0-a8b9-d8e35891429c req-15b1b7f5-f4e5-4055-b696-218b6a1bf1db service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:15.721857 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-39fa784e-f148-41a0-a8b9-d8e35891429c req-15b1b7f5-f4e5-4055-b696-218b6a1bf1db service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:15.742295 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-39fa784e-f148-41a0-a8b9-d8e35891429c req-15b1b7f5-f4e5-4055-b696-218b6a1bf1db service nova] Creating event network-changed:65e61e03-b843-4f81-a0bd-e91f48fb2530 for instance 847436df-06b3-44b3-99f3-6ea7898a4a08 on hv-cinder-82549 Jul 12 07:24:15.748119 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-39fa784e-f148-41a0-a8b9-d8e35891429c req-15b1b7f5-f4e5-4055-b696-218b6a1bf1db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047761 Jul 12 07:24:15.749127 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 535/1079] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:24:15.805276 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c183960c-1c76-4a6b-9cac-2b83dd37097c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:15.806471 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c183960c-1c76-4a6b-9cac-2b83dd37097c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:15.814848 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c183960c-1c76-4a6b-9cac-2b83dd37097c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:15.815577 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c183960c-1c76-4a6b-9cac-2b83dd37097c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:15.819041 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c183960c-1c76-4a6b-9cac-2b83dd37097c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:15.819685 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c183960c-1c76-4a6b-9cac-2b83dd37097c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:16.480488 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c183960c-1c76-4a6b-9cac-2b83dd37097c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:16.488816 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c183960c-1c76-4a6b-9cac-2b83dd37097c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.694057 Jul 12 07:24:16.489450 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 545/1080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:15 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:17.471358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-946a2f0a-27ea-4678-8e0f-7b997dedc132 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:17.471913 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-946a2f0a-27ea-4678-8e0f-7b997dedc132 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:17.478412 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-946a2f0a-27ea-4678-8e0f-7b997dedc132 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:17.478848 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-946a2f0a-27ea-4678-8e0f-7b997dedc132 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:17.479582 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-946a2f0a-27ea-4678-8e0f-7b997dedc132 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:17.480004 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-946a2f0a-27ea-4678-8e0f-7b997dedc132 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:17.506742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c1ff6cee-887e-4fc6-a925-31a4a6eedbe1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:17.507316 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c1ff6cee-887e-4fc6-a925-31a4a6eedbe1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:17.513783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1ff6cee-887e-4fc6-a925-31a4a6eedbe1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:17.514218 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1ff6cee-887e-4fc6-a925-31a4a6eedbe1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:17.515304 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1ff6cee-887e-4fc6-a925-31a4a6eedbe1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:17.515645 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1ff6cee-887e-4fc6-a925-31a4a6eedbe1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:17.564316 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.objects.instance [None req-946a2f0a-27ea-4678-8e0f-7b997dedc132 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lazy-loading 'services' on Instance uuid 847436df-06b3-44b3-99f3-6ea7898a4a08 {{(pid=117998) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:24:17.642147 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-946a2f0a-27ea-4678-8e0f-7b997dedc132 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments/6faf4a1b-e595-49dd-a249-26759a379d5c" status: 202 len: 0 microversion: 2.1 time: 0.175348 Jul 12 07:24:17.644202 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 536/1081] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:24:17 2022] DELETE /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments/6faf4a1b-e595-49dd-a249-26759a379d5c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:24:17.655874 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9de05ab3-0922-45af-9eb6-4090f25aa97c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:17.656746 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-9de05ab3-0922-45af-9eb6-4090f25aa97c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:17.665640 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9de05ab3-0922-45af-9eb6-4090f25aa97c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:17.666264 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9de05ab3-0922-45af-9eb6-4090f25aa97c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:17.667141 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9de05ab3-0922-45af-9eb6-4090f25aa97c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:17.667831 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-9de05ab3-0922-45af-9eb6-4090f25aa97c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:17.684889 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c1ff6cee-887e-4fc6-a925-31a4a6eedbe1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:17.694317 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c1ff6cee-887e-4fc6-a925-31a4a6eedbe1 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.191905 Jul 12 07:24:17.696619 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 546/1082] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:17 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:17.699928 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9de05ab3-0922-45af-9eb6-4090f25aa97c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050407 Jul 12 07:24:17.700653 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 537/1083] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:24:17 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:24:17.763722 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-396ddc17-dffc-4eb8-92fa-758ad369ac6b req-260923ee-2e89-4faf-ba2b-6151ffa988a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847436df-06b3-44b3-99f3-6ea7898a4a08", "tag": "65e61e03-b843-4f81-a0bd-e91f48fb2530"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:24:17.772979 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-396ddc17-dffc-4eb8-92fa-758ad369ac6b req-260923ee-2e89-4faf-ba2b-6151ffa988a3 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:17.773441 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-396ddc17-dffc-4eb8-92fa-758ad369ac6b req-260923ee-2e89-4faf-ba2b-6151ffa988a3 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:17.786324 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-396ddc17-dffc-4eb8-92fa-758ad369ac6b req-260923ee-2e89-4faf-ba2b-6151ffa988a3 service nova] Creating event network-changed:65e61e03-b843-4f81-a0bd-e91f48fb2530 for instance 847436df-06b3-44b3-99f3-6ea7898a4a08 on hv-cinder-82549 Jul 12 07:24:17.792219 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-396ddc17-dffc-4eb8-92fa-758ad369ac6b req-260923ee-2e89-4faf-ba2b-6151ffa988a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033091 Jul 12 07:24:17.793112 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 547/1084] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:24:18.714604 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-381bc6dd-9188-4ac8-8069-1236ce139d3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:18.715397 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4f22f861-9a04-4bdc-8cd4-862f6951814c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:18.715869 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-381bc6dd-9188-4ac8-8069-1236ce139d3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:18.716126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4f22f861-9a04-4bdc-8cd4-862f6951814c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:18.718422 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:18.719102 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=6 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:18.722531 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-381bc6dd-9188-4ac8-8069-1236ce139d3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:18.723001 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-381bc6dd-9188-4ac8-8069-1236ce139d3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:18.723788 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-381bc6dd-9188-4ac8-8069-1236ce139d3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:18.724241 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-381bc6dd-9188-4ac8-8069-1236ce139d3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:18.725546 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f22f861-9a04-4bdc-8cd4-862f6951814c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:18.726007 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f22f861-9a04-4bdc-8cd4-862f6951814c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:18.727140 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f22f861-9a04-4bdc-8cd4-862f6951814c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:18.727589 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f22f861-9a04-4bdc-8cd4-862f6951814c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:18.755130 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-381bc6dd-9188-4ac8-8069-1236ce139d3e tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Jul 12 07:24:18.755915 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 538/1085] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:24:18 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:24:18.876452 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4f22f861-9a04-4bdc-8cd4-862f6951814c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:18.887692 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4f22f861-9a04-4bdc-8cd4-862f6951814c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.177204 Jul 12 07:24:18.888607 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 548/1086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:18 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:19.772097 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-121038cd-ec15-4bd0-b7de-04fc0098ede8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:19.773498 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-121038cd-ec15-4bd0-b7de-04fc0098ede8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:19.776980 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:19.786839 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-121038cd-ec15-4bd0-b7de-04fc0098ede8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:19.787578 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-121038cd-ec15-4bd0-b7de-04fc0098ede8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:19.789081 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-121038cd-ec15-4bd0-b7de-04fc0098ede8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:19.789508 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-121038cd-ec15-4bd0-b7de-04fc0098ede8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:19.817755 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-121038cd-ec15-4bd0-b7de-04fc0098ede8 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052580 Jul 12 07:24:19.818307 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 539/1087] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 07:24:19 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 07:24:19.828742 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:19.829302 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:19.835966 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:19.836404 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:19.837177 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:19.837605 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:19.909751 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-a5c68a93-80ec-42af-bd37-6cc912b719f9 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:19.910189 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-a5c68a93-80ec-42af-bd37-6cc912b719f9 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:19.916536 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a5c68a93-80ec-42af-bd37-6cc912b719f9 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:19.916981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a5c68a93-80ec-42af-bd37-6cc912b719f9 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:19.917586 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] HTTP exception thrown: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 is not attached to volume 6faf4a1b-e595-49dd-a249-26759a379d5c Jul 12 07:24:19.917734 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a5c68a93-80ec-42af-bd37-6cc912b719f9 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:19.918190 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-a5c68a93-80ec-42af-bd37-6cc912b719f9 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Request method failure captured: Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: DELETE /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments/6faf4a1b-e595-49dd-a249-26759a379d5c HTTP/1.1 Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSEJ05y3SK8i9GXy8E1RLhPh3-cH710nLJKKaI_z2a_F4w-XjkeJKHrC-v7IH-a730fblisNCVBLija1ary8kCnUiPH3NM0cnny7VsXRvKQj8m_2ILdsxCUswkfVUlNO4lG3YT3E0u9xSZrovM-IkeBtR_SbOwdp6LAKUuab4qaPzR8 Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 34750fb4357248b7a99cc1f0baaad4ae Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-TestMinimumBasicScenario-1751367318 Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:24:19.919940 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34750fb4357248b7a99cc1f0baaad4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34750fb4357248b7a99cc1f0baaad4ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34750fb4357248b7a99cc1f0baaad4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34750fb4357248b7a99cc1f0baaad4ae"}]}] Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-TestMinimumBasicScenario-1751367318 Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 34750fb4357248b7a99cc1f0baaad4ae Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1751367318 Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-TestMinimumBasicScenario-1751367318-project Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: e824ff37e1724f549f1e113013c554fe Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-TestMinimumBasicScenario-1751367318-project Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:24:19.921451 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 is not attached to volume 6faf4a1b-e595-49dd-a249-26759a379d5c Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'server_id': '847436df-06b3-44b3-99f3-6ea7898a4a08', 'id': '6faf4a1b-e595-49dd-a249-26759a379d5c'} Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6faf4a1b-e595-49dd-a249-26759a379d5c. Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:24:19.922282 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 is not attached to volume 6faf4a1b-e595-49dd-a249-26759a379d5c Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 is not attached to volume 6faf4a1b-e595-49dd-a249-26759a379d5c Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:24:19.923562 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Returning 404 to user: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 is not attached to volume 6faf4a1b-e595-49dd-a249-26759a379d5c {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:24:19.924789 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d2232388-8302-4de2-a4b7-6bdb3ab5c347 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments/6faf4a1b-e595-49dd-a249-26759a379d5c" status: 404 len: 154 microversion: 2.1 time: 0.096681 Jul 12 07:24:19.924789 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 549/1088] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 07:24:19 2022] DELETE /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08/os-volume_attachments/6faf4a1b-e595-49dd-a249-26759a379d5c => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:24:20.059859 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-a5c68a93-80ec-42af-bd37-6cc912b719f9 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:20.067542 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-a5c68a93-80ec-42af-bd37-6cc912b719f9 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.161944 Jul 12 07:24:20.068107 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 540/1089] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:19 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:21.063421 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e60ab1ea-a5c0-401a-b98e-72c231852fbb tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:21.063995 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e60ab1ea-a5c0-401a-b98e-72c231852fbb tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:21.072135 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e60ab1ea-a5c0-401a-b98e-72c231852fbb tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:21.072459 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e60ab1ea-a5c0-401a-b98e-72c231852fbb tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:21.073259 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e60ab1ea-a5c0-401a-b98e-72c231852fbb tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:21.073706 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e60ab1ea-a5c0-401a-b98e-72c231852fbb tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:21.084780 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-938beb60-1ce5-4df0-84e2-878f3bd7d753 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:21.085431 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-938beb60-1ce5-4df0-84e2-878f3bd7d753 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:21.092263 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-938beb60-1ce5-4df0-84e2-878f3bd7d753 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:21.092707 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-938beb60-1ce5-4df0-84e2-878f3bd7d753 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:21.093503 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-938beb60-1ce5-4df0-84e2-878f3bd7d753 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:21.093937 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-938beb60-1ce5-4df0-84e2-878f3bd7d753 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:21.104104 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e60ab1ea-a5c0-401a-b98e-72c231852fbb tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:24:21.197669 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e60ab1ea-a5c0-401a-b98e-72c231852fbb tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "DELETE /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 204 len: 0 microversion: 2.1 time: 0.137710 Jul 12 07:24:21.198701 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 550/1090] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:24:21 2022] DELETE /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:24:21.208115 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d7fa20cd-3650-4c3d-b330-db61ef1ef9f3 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:21.208896 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d7fa20cd-3650-4c3d-b330-db61ef1ef9f3 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:21.218804 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fa20cd-3650-4c3d-b330-db61ef1ef9f3 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:21.219247 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fa20cd-3650-4c3d-b330-db61ef1ef9f3 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:21.220017 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fa20cd-3650-4c3d-b330-db61ef1ef9f3 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:21.220443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fa20cd-3650-4c3d-b330-db61ef1ef9f3 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:21.241949 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-938beb60-1ce5-4df0-84e2-878f3bd7d753 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:21.251224 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-938beb60-1ce5-4df0-84e2-878f3bd7d753 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.170171 Jul 12 07:24:21.251795 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 541/1091] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:21 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:21.349446 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d7fa20cd-3650-4c3d-b330-db61ef1ef9f3 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:21.357639 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d7fa20cd-3650-4c3d-b330-db61ef1ef9f3 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1556 microversion: 2.1 time: 0.153769 Jul 12 07:24:21.358210 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 551/1092] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:21 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:22.272290 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-62b96e81-dcd5-4c46-9636-f793e873b861 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:22.273141 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-62b96e81-dcd5-4c46-9636-f793e873b861 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:22.284765 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62b96e81-dcd5-4c46-9636-f793e873b861 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:22.285555 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62b96e81-dcd5-4c46-9636-f793e873b861 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:22.286812 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62b96e81-dcd5-4c46-9636-f793e873b861 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:22.287509 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-62b96e81-dcd5-4c46-9636-f793e873b861 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:22.375288 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fd51cdb8-e5e5-4c43-acea-22d0b0a06b3c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:22.375877 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fd51cdb8-e5e5-4c43-acea-22d0b0a06b3c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:22.382965 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd51cdb8-e5e5-4c43-acea-22d0b0a06b3c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:22.383808 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd51cdb8-e5e5-4c43-acea-22d0b0a06b3c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:22.385017 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd51cdb8-e5e5-4c43-acea-22d0b0a06b3c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:22.385017 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd51cdb8-e5e5-4c43-acea-22d0b0a06b3c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:22.477030 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-62b96e81-dcd5-4c46-9636-f793e873b861 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:22.487204 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-62b96e81-dcd5-4c46-9636-f793e873b861 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.221413 Jul 12 07:24:22.488230 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 542/1093] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:22 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:22.543652 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fd51cdb8-e5e5-4c43-acea-22d0b0a06b3c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:22.553169 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fd51cdb8-e5e5-4c43-acea-22d0b0a06b3c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1556 microversion: 2.1 time: 0.181739 Jul 12 07:24:22.553852 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 552/1094] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:22 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:22.598416 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-f1594a88-1972-422a-bd52-d9e04caf0158 req-ff8d7f1d-ec31-49fb-81c3-e460152be2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d2c727-3181-42c2-a071-fa7eec04b391", "name": "network-vif-plugged", "status": "completed", "tag": "790fc29e-5907-4b44-bcfc-4b171e467d88"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:24:22.606244 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-f1594a88-1972-422a-bd52-d9e04caf0158 req-ff8d7f1d-ec31-49fb-81c3-e460152be2cd service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:22.606899 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-f1594a88-1972-422a-bd52-d9e04caf0158 req-ff8d7f1d-ec31-49fb-81c3-e460152be2cd service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:22.617547 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-f1594a88-1972-422a-bd52-d9e04caf0158 req-ff8d7f1d-ec31-49fb-81c3-e460152be2cd service nova] Creating event network-vif-plugged:790fc29e-5907-4b44-bcfc-4b171e467d88 for instance f0d2c727-3181-42c2-a071-fa7eec04b391 on hv-cinder-82549 Jul 12 07:24:22.622535 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-f1594a88-1972-422a-bd52-d9e04caf0158 req-ff8d7f1d-ec31-49fb-81c3-e460152be2cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099730 Jul 12 07:24:22.623143 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 543/1095] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 07:24:23.503870 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b848e309-5ded-44f9-9267-851616e7267e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:23.504453 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b848e309-5ded-44f9-9267-851616e7267e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:23.511793 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b848e309-5ded-44f9-9267-851616e7267e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:23.512239 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b848e309-5ded-44f9-9267-851616e7267e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:23.513000 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b848e309-5ded-44f9-9267-851616e7267e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:23.513463 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b848e309-5ded-44f9-9267-851616e7267e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:23.571425 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0a1cd7f5-3726-45cb-91c2-85c26143b744 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:23.572107 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0a1cd7f5-3726-45cb-91c2-85c26143b744 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:23.579395 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7f5-3726-45cb-91c2-85c26143b744 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:23.579974 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7f5-3726-45cb-91c2-85c26143b744 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:23.580742 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7f5-3726-45cb-91c2-85c26143b744 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:23.581338 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0a1cd7f5-3726-45cb-91c2-85c26143b744 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:23.701859 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b848e309-5ded-44f9-9267-851616e7267e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:23.705458 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:23.710459 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b848e309-5ded-44f9-9267-851616e7267e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1266 microversion: 2.1 time: 0.210488 Jul 12 07:24:23.711257 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 553/1096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:23 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:23.745224 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0a1cd7f5-3726-45cb-91c2-85c26143b744 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:23.749371 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:23.754844 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0a1cd7f5-3726-45cb-91c2-85c26143b744 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1556 microversion: 2.1 time: 0.187849 Jul 12 07:24:23.755792 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 544/1097] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:23 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:24:23.906119 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-ca4115e6-7825-4d26-aad5-da2bc8ebbc5f req-169fbe6f-b927-4037-a6af-be477a4edddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847436df-06b3-44b3-99f3-6ea7898a4a08", "name": "network-vif-deleted", "tag": "65e61e03-b843-4f81-a0bd-e91f48fb2530"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:24:23.916988 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-ca4115e6-7825-4d26-aad5-da2bc8ebbc5f req-169fbe6f-b927-4037-a6af-be477a4edddf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:23.917574 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-ca4115e6-7825-4d26-aad5-da2bc8ebbc5f req-169fbe6f-b927-4037-a6af-be477a4edddf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:23.936049 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-ca4115e6-7825-4d26-aad5-da2bc8ebbc5f req-169fbe6f-b927-4037-a6af-be477a4edddf service nova] Creating event network-vif-deleted:65e61e03-b843-4f81-a0bd-e91f48fb2530 for instance 847436df-06b3-44b3-99f3-6ea7898a4a08 on hv-cinder-82549 Jul 12 07:24:23.943123 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-ca4115e6-7825-4d26-aad5-da2bc8ebbc5f req-169fbe6f-b927-4037-a6af-be477a4edddf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104391 Jul 12 07:24:23.943710 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 554/1098] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:24:24.728696 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-dac2ef8a-9ff9-4ecf-a521-00c507fd6890 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:24.729349 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-dac2ef8a-9ff9-4ecf-a521-00c507fd6890 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:24.736406 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dac2ef8a-9ff9-4ecf-a521-00c507fd6890 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:24.736838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dac2ef8a-9ff9-4ecf-a521-00c507fd6890 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:24.737614 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dac2ef8a-9ff9-4ecf-a521-00c507fd6890 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:24.738041 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-dac2ef8a-9ff9-4ecf-a521-00c507fd6890 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:24.772825 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:24.773676 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:24.780583 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:24.781030 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:24.781817 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:24.782244 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:24.813557 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:24.813999 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:24.814442 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lazy-loading 'fault' on Instance uuid 847436df-06b3-44b3-99f3-6ea7898a4a08 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 07:24:24.864591 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e824ff37e1724f549f1e113013c554fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34750fb4357248b7a99cc1f0baaad4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:24.872535 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7d6906f2-df6e-443b-94d8-5769e0ac3fa2 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 200 len: 1349 microversion: 2.1 time: 0.104356 Jul 12 07:24:24.873136 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 555/1099] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:24 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:24.896750 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-dac2ef8a-9ff9-4ecf-a521-00c507fd6890 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:24.905204 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-dac2ef8a-9ff9-4ecf-a521-00c507fd6890 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1454 microversion: 2.1 time: 0.181082 Jul 12 07:24:24.905754 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 545/1100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:24 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:24.921797 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-92c6484b-4059-4595-9600-60fb71117f91 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:24.922402 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-92c6484b-4059-4595-9600-60fb71117f91 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:24.928611 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92c6484b-4059-4595-9600-60fb71117f91 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:24.928992 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92c6484b-4059-4595-9600-60fb71117f91 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:24.929778 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92c6484b-4059-4595-9600-60fb71117f91 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:24.930210 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92c6484b-4059-4595-9600-60fb71117f91 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:25.069679 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-92c6484b-4059-4595-9600-60fb71117f91 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:24:25.077849 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-92c6484b-4059-4595-9600-60fb71117f91 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1454 microversion: 2.1 time: 0.160210 Jul 12 07:24:25.078426 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 556/1101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:24 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:24:25.894461 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:25.895648 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] [instance: 847436df-06b3-44b3-99f3-6ea7898a4a08] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:24:25.907034 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:25.907817 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:25.909174 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:25.909927 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:25.935962 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] HTTP exception thrown: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 could not be found. Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Request method failure captured: Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 HTTP/1.1 Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizSEJ05y3SK8i9GXy8E1RLhPh3-cH710nLJKKaI_z2a_F4w-XjkeJKHrC-v7IH-a730fblisNCVBLija1ary8kCnUiPH3NM0cnny7VsXRvKQj8m_2ILdsxCUswkfVUlNO4lG3YT3E0u9xSZrovM-IkeBtR_SbOwdp6LAKUuab4qaPzR8 Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 34750fb4357248b7a99cc1f0baaad4ae Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-TestMinimumBasicScenario-1751367318 Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:24:25.939301 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34750fb4357248b7a99cc1f0baaad4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/34750fb4357248b7a99cc1f0baaad4ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_34750fb4357248b7a99cc1f0baaad4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/34750fb4357248b7a99cc1f0baaad4ae"}]}] Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-TestMinimumBasicScenario-1751367318 Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 34750fb4357248b7a99cc1f0baaad4ae Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1751367318 Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-TestMinimumBasicScenario-1751367318-project Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: e824ff37e1724f549f1e113013c554fe Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-TestMinimumBasicScenario-1751367318-project Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 could not be found. Jul 12 07:24:25.941083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '847436df-06b3-44b3-99f3-6ea7898a4a08'} Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 could not be found. Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:24:25.942063 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 could not be found. Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 could not be found. Jul 12 07:24:25.947280 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:24:25.949083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Returning 404 to user: Instance 847436df-06b3-44b3-99f3-6ea7898a4a08 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:24:25.949083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fdb4fa58-42fe-43f2-b757-a8dac9764883 tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08" status: 404 len: 111 microversion: 2.1 time: 0.054472 Jul 12 07:24:25.949083 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 546/1102] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:24:25 2022] GET /compute/v2.1/servers/847436df-06b3-44b3-99f3-6ea7898a4a08 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:24:25.953305 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eef09289-19f4-44e2-b38e-ec3a3011f03c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] Calling method '.version_select at 0x7f70115faa60>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:24:25.974923 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eef09289-19f4-44e2-b38e-ec3a3011f03c tempest-TestMinimumBasicScenario-1751367318 tempest-TestMinimumBasicScenario-1751367318-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1158660468" status: 202 len: 0 microversion: 2.1 time: 0.027018 Jul 12 07:24:25.975501 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 557/1103] 10.222.0.25 () {58 vars in 1271 bytes} [Tue Jul 12 07:24:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1158660468 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:24:26.726211 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-c89bb74b-5836-439d-b080-3ae04f86fe40 req-746839a4-736b-4cb9-bcb1-cc47b9923a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d2c727-3181-42c2-a071-fa7eec04b391", "tag": "790fc29e-5907-4b44-bcfc-4b171e467d88"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:24:26.734830 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c89bb74b-5836-439d-b080-3ae04f86fe40 req-746839a4-736b-4cb9-bcb1-cc47b9923a02 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:24:26.735271 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-c89bb74b-5836-439d-b080-3ae04f86fe40 req-746839a4-736b-4cb9-bcb1-cc47b9923a02 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:24:26.746774 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-c89bb74b-5836-439d-b080-3ae04f86fe40 req-746839a4-736b-4cb9-bcb1-cc47b9923a02 service nova] Creating event network-changed:790fc29e-5907-4b44-bcfc-4b171e467d88 for instance f0d2c727-3181-42c2-a071-fa7eec04b391 on hv-cinder-82549 Jul 12 07:24:26.751979 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-c89bb74b-5836-439d-b080-3ae04f86fe40 req-746839a4-736b-4cb9-bcb1-cc47b9923a02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029321 Jul 12 07:24:26.752577 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 547/1104] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:24:55.863210 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:24:55.864037 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Tue Jul 12 07:24:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:26:13.882205 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90be64d4-1571-4d0c-824f-be31963ef539] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 07:26:13.882869 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=16 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:13.883617 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:13.887927 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1666357567", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1485749986", "security_groups": [{"name": "tempest-secgroup-smoke-1734143131"}], "block_device_mapping_v2": [{"uuid": "7792ddb3-e4cc-4a6c-9ee4-2092f8284a71", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e1f0417e-f44e-4fb0-a137-3bcf769956d0"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:26:14.004259 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] validate_networks() for [('e1f0417e-f44e-4fb0-a137-3bcf769956d0', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 07:26:14.493575 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 07:26:14.494165 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 07:26:14.494909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 07:26:14.495349 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 07:26:14.495910 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 07:26:14.508683 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:14.509225 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:14.510187 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:14.510783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:14.528095 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Getting quotas for project 883812495f3940a3bdeff8d4c08a29c3. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 07:26:14.532466 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Getting quotas for user 5279c7bf349746b4a4622f72945662ea and project 883812495f3940a3bdeff8d4c08a29c3. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 07:26:14.607137 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 07:26:14.609337 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7792ddb3-e4cc-4a6c-9ee4-2092f8284a71',volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 07:26:14.742996 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-da9f99d2-dce4-49b0-a8d4-615ed9e72511 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.862544 Jul 12 07:26:14.743856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 558/1105] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 07:26:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 07:26:14.752641 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:14.753369 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=10 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:14.758838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-de7c2443-24a3-4b94-bc94-8d9b7214bf73 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:14.760620 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-de7c2443-24a3-4b94-bc94-8d9b7214bf73 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:14.818113 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-de7c2443-24a3-4b94-bc94-8d9b7214bf73 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:14.824981 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-de7c2443-24a3-4b94-bc94-8d9b7214bf73 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1095 microversion: 2.1 time: 0.074746 Jul 12 07:26:14.829722 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 548/1106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:14 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:15.843084 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ee0f755e-3346-4044-9ea0-b0cb43558caa tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:15.843690 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ee0f755e-3346-4044-9ea0-b0cb43558caa tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:15.850822 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee0f755e-3346-4044-9ea0-b0cb43558caa tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:15.851263 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee0f755e-3346-4044-9ea0-b0cb43558caa tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:15.852025 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee0f755e-3346-4044-9ea0-b0cb43558caa tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:15.852454 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee0f755e-3346-4044-9ea0-b0cb43558caa tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:15.858970 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] [90be64d4-1571-4d0c-824f-be31963ef539] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 46478. Jul 12 07:26:15.925070 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ee0f755e-3346-4044-9ea0-b0cb43558caa tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:15.933014 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ee0f755e-3346-4044-9ea0-b0cb43558caa tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1201 microversion: 2.1 time: 0.094988 Jul 12 07:26:15.934607 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 559/1107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:15 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:16.951652 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-f7f24b67-3b98-4c6a-b646-71cf95b67450 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:16.952253 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-f7f24b67-3b98-4c6a-b646-71cf95b67450 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:16.959607 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7f24b67-3b98-4c6a-b646-71cf95b67450 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:16.960034 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7f24b67-3b98-4c6a-b646-71cf95b67450 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:16.960785 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7f24b67-3b98-4c6a-b646-71cf95b67450 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:16.961253 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-f7f24b67-3b98-4c6a-b646-71cf95b67450 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:17.095999 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-f7f24b67-3b98-4c6a-b646-71cf95b67450 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:17.106699 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-f7f24b67-3b98-4c6a-b646-71cf95b67450 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.159177 Jul 12 07:26:17.108222 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 549/1108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:16 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:17.372289 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-dab984b5-c1eb-4162-a788-1818d9078538 req-cbc8fc26-f775-49da-9a5f-742e23eb55b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dc00cd-e8cb-41c3-8f5c-e85a84168561", "tag": "6af08d61-5ffe-4713-a4c7-8d512c338a1f"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:26:17.383779 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-dab984b5-c1eb-4162-a788-1818d9078538 req-cbc8fc26-f775-49da-9a5f-742e23eb55b1 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:17.384402 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-dab984b5-c1eb-4162-a788-1818d9078538 req-cbc8fc26-f775-49da-9a5f-742e23eb55b1 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:17.397866 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-dab984b5-c1eb-4162-a788-1818d9078538 req-cbc8fc26-f775-49da-9a5f-742e23eb55b1 service nova] Creating event network-changed:6af08d61-5ffe-4713-a4c7-8d512c338a1f for instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 on hv-cinder-82549 Jul 12 07:26:17.404274 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-dab984b5-c1eb-4162-a788-1818d9078538 req-cbc8fc26-f775-49da-9a5f-742e23eb55b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036508 Jul 12 07:26:17.405168 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 560/1109] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:26:18.124109 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-4c7acb43-93ad-4cd2-baeb-c1adf7d133eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:18.124816 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-4c7acb43-93ad-4cd2-baeb-c1adf7d133eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:18.131793 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c7acb43-93ad-4cd2-baeb-c1adf7d133eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:18.132304 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c7acb43-93ad-4cd2-baeb-c1adf7d133eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:18.133143 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c7acb43-93ad-4cd2-baeb-c1adf7d133eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:18.133666 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-4c7acb43-93ad-4cd2-baeb-c1adf7d133eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:18.271441 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-4c7acb43-93ad-4cd2-baeb-c1adf7d133eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:18.279466 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-4c7acb43-93ad-4cd2-baeb-c1adf7d133eb tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.159327 Jul 12 07:26:18.280031 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 550/1110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:18 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:19.301835 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8571df01-6d01-44ac-90cc-4b709e1e6e7f tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:19.302724 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8571df01-6d01-44ac-90cc-4b709e1e6e7f tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:19.310894 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8571df01-6d01-44ac-90cc-4b709e1e6e7f tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:19.311340 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8571df01-6d01-44ac-90cc-4b709e1e6e7f tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:19.312089 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8571df01-6d01-44ac-90cc-4b709e1e6e7f tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:19.312517 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8571df01-6d01-44ac-90cc-4b709e1e6e7f tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:19.454890 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8571df01-6d01-44ac-90cc-4b709e1e6e7f tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:19.462860 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8571df01-6d01-44ac-90cc-4b709e1e6e7f tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.168948 Jul 12 07:26:19.463436 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 561/1111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:19 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:20.483130 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-16f4051b-a679-47ab-9c26-5d0d8b885318 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:20.483815 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-16f4051b-a679-47ab-9c26-5d0d8b885318 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:20.491760 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-16f4051b-a679-47ab-9c26-5d0d8b885318 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:20.492279 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-16f4051b-a679-47ab-9c26-5d0d8b885318 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:20.493200 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-16f4051b-a679-47ab-9c26-5d0d8b885318 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:20.493698 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-16f4051b-a679-47ab-9c26-5d0d8b885318 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:20.641368 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-16f4051b-a679-47ab-9c26-5d0d8b885318 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:20.649368 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-16f4051b-a679-47ab-9c26-5d0d8b885318 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.171872 Jul 12 07:26:20.649934 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 551/1112] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:20 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:21.671432 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17418fba-9a34-4474-97f5-1a2ab19a6db2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:21.672302 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17418fba-9a34-4474-97f5-1a2ab19a6db2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:21.683503 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17418fba-9a34-4474-97f5-1a2ab19a6db2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:21.683950 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17418fba-9a34-4474-97f5-1a2ab19a6db2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:21.684720 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17418fba-9a34-4474-97f5-1a2ab19a6db2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:21.685145 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17418fba-9a34-4474-97f5-1a2ab19a6db2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:21.817687 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-17418fba-9a34-4474-97f5-1a2ab19a6db2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:21.827576 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17418fba-9a34-4474-97f5-1a2ab19a6db2 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.163158 Jul 12 07:26:21.828122 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 562/1113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:21 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:22.855172 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-882199ad-2dfb-4951-a35a-d4c3027e0c8e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:22.858838 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-882199ad-2dfb-4951-a35a-d4c3027e0c8e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:22.868614 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-882199ad-2dfb-4951-a35a-d4c3027e0c8e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:22.869089 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-882199ad-2dfb-4951-a35a-d4c3027e0c8e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:22.869853 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-882199ad-2dfb-4951-a35a-d4c3027e0c8e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:22.870275 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-882199ad-2dfb-4951-a35a-d4c3027e0c8e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:23.009863 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-882199ad-2dfb-4951-a35a-d4c3027e0c8e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:23.017649 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-882199ad-2dfb-4951-a35a-d4c3027e0c8e tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.169195 Jul 12 07:26:23.018217 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 552/1114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:22 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:24.035424 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c8446b1e-9dbd-4c7d-967d-15942d58fc3c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:24.036059 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c8446b1e-9dbd-4c7d-967d-15942d58fc3c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:24.043162 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8446b1e-9dbd-4c7d-967d-15942d58fc3c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:24.043634 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8446b1e-9dbd-4c7d-967d-15942d58fc3c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:24.044739 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8446b1e-9dbd-4c7d-967d-15942d58fc3c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:24.045511 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8446b1e-9dbd-4c7d-967d-15942d58fc3c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:24.186221 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c8446b1e-9dbd-4c7d-967d-15942d58fc3c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:24.194994 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c8446b1e-9dbd-4c7d-967d-15942d58fc3c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.163583 Jul 12 07:26:24.195561 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 563/1115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:24 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:25.211926 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-08915879-2223-4df5-897d-9357b799fdd6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:25.212605 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-08915879-2223-4df5-897d-9357b799fdd6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:25.215011 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell0:SELECT=2 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:25.220558 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08915879-2223-4df5-897d-9357b799fdd6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:25.221005 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08915879-2223-4df5-897d-9357b799fdd6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:25.221794 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08915879-2223-4df5-897d-9357b799fdd6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:25.222223 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-08915879-2223-4df5-897d-9357b799fdd6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:25.357688 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-08915879-2223-4df5-897d-9357b799fdd6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:25.367793 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-08915879-2223-4df5-897d-9357b799fdd6 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.159367 Jul 12 07:26:25.368560 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 553/1116] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:25 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:26.391342 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ba565586-2660-4ba6-8d9b-0461957c94c4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:26.392230 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ba565586-2660-4ba6-8d9b-0461957c94c4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:26.395350 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:26.396467 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=6 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:26.406348 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba565586-2660-4ba6-8d9b-0461957c94c4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:26.406790 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba565586-2660-4ba6-8d9b-0461957c94c4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:26.407563 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba565586-2660-4ba6-8d9b-0461957c94c4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:26.407993 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba565586-2660-4ba6-8d9b-0461957c94c4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:26.553564 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ba565586-2660-4ba6-8d9b-0461957c94c4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:26.561444 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ba565586-2660-4ba6-8d9b-0461957c94c4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.176960 Jul 12 07:26:26.562116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 564/1117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:26 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:27.132944 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-ebb6de10-dc73-488b-862c-fda2eed6adca req-feb68b58-844d-4467-8017-ed7b3e9a1ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dc00cd-e8cb-41c3-8f5c-e85a84168561", "name": "network-vif-plugged", "status": "completed", "tag": "6af08d61-5ffe-4713-a4c7-8d512c338a1f"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:26:27.142133 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ebb6de10-dc73-488b-862c-fda2eed6adca req-feb68b58-844d-4467-8017-ed7b3e9a1ed2 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:27.142540 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-ebb6de10-dc73-488b-862c-fda2eed6adca req-feb68b58-844d-4467-8017-ed7b3e9a1ed2 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:27.154414 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-ebb6de10-dc73-488b-862c-fda2eed6adca req-feb68b58-844d-4467-8017-ed7b3e9a1ed2 service nova] Creating event network-vif-plugged:6af08d61-5ffe-4713-a4c7-8d512c338a1f for instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 on hv-cinder-82549 Jul 12 07:26:27.159886 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-ebb6de10-dc73-488b-862c-fda2eed6adca req-feb68b58-844d-4467-8017-ed7b3e9a1ed2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030540 Jul 12 07:26:27.160480 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 554/1118] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:26:27.583648 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e83c5e5c-a3ba-4277-817a-370c057350f4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:27.584671 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e83c5e5c-a3ba-4277-817a-370c057350f4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:27.596540 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e83c5e5c-a3ba-4277-817a-370c057350f4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:27.597347 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e83c5e5c-a3ba-4277-817a-370c057350f4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:27.598663 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e83c5e5c-a3ba-4277-817a-370c057350f4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:27.599386 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e83c5e5c-a3ba-4277-817a-370c057350f4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:27.755973 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e83c5e5c-a3ba-4277-817a-370c057350f4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:27.763709 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e83c5e5c-a3ba-4277-817a-370c057350f4 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.187506 Jul 12 07:26:27.764253 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 565/1119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:27 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:28.787351 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-0201aeaa-b16a-454f-8eeb-4c5664e0507c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:28.788481 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-0201aeaa-b16a-454f-8eeb-4c5664e0507c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:28.798603 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0201aeaa-b16a-454f-8eeb-4c5664e0507c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:28.799040 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0201aeaa-b16a-454f-8eeb-4c5664e0507c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:28.799794 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0201aeaa-b16a-454f-8eeb-4c5664e0507c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:28.800220 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-0201aeaa-b16a-454f-8eeb-4c5664e0507c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:28.947840 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-0201aeaa-b16a-454f-8eeb-4c5664e0507c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:28.958074 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-0201aeaa-b16a-454f-8eeb-4c5664e0507c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1267 microversion: 2.1 time: 0.179375 Jul 12 07:26:28.958647 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 555/1120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:28 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:29.979209 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e94a4cc3-33b5-445a-89cb-42646b223b27 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:29.980146 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e94a4cc3-33b5-445a-89cb-42646b223b27 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:29.991362 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e94a4cc3-33b5-445a-89cb-42646b223b27 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:29.992061 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e94a4cc3-33b5-445a-89cb-42646b223b27 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:29.993407 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e94a4cc3-33b5-445a-89cb-42646b223b27 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:29.994126 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e94a4cc3-33b5-445a-89cb-42646b223b27 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:30.126674 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e94a4cc3-33b5-445a-89cb-42646b223b27 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:30.134370 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e94a4cc3-33b5-445a-89cb-42646b223b27 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1454 microversion: 2.1 time: 0.161668 Jul 12 07:26:30.134936 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 566/1121] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:29 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:30.150575 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fac8c151-2dd0-4d28-917e-38eb52992520 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:26:30.151183 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fac8c151-2dd0-4d28-917e-38eb52992520 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:26:30.158342 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fac8c151-2dd0-4d28-917e-38eb52992520 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:30.158785 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fac8c151-2dd0-4d28-917e-38eb52992520 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:30.159549 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fac8c151-2dd0-4d28-917e-38eb52992520 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:30.159984 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fac8c151-2dd0-4d28-917e-38eb52992520 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:30.297612 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-fac8c151-2dd0-4d28-917e-38eb52992520 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:26:30.305522 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fac8c151-2dd0-4d28-917e-38eb52992520 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1454 microversion: 2.1 time: 0.158780 Jul 12 07:26:30.306093 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 556/1122] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:26:30 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:26:31.933042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-d79a3e57-df45-4d32-be43-8021a65b6c48 req-bcb420fe-d97d-4c16-9ba1-7f02b325f9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dc00cd-e8cb-41c3-8f5c-e85a84168561", "tag": "6af08d61-5ffe-4713-a4c7-8d512c338a1f"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:26:31.941783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-d79a3e57-df45-4d32-be43-8021a65b6c48 req-bcb420fe-d97d-4c16-9ba1-7f02b325f9bf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:26:31.942216 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-d79a3e57-df45-4d32-be43-8021a65b6c48 req-bcb420fe-d97d-4c16-9ba1-7f02b325f9bf service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:26:31.953651 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-d79a3e57-df45-4d32-be43-8021a65b6c48 req-bcb420fe-d97d-4c16-9ba1-7f02b325f9bf service nova] Creating event network-changed:6af08d61-5ffe-4713-a4c7-8d512c338a1f for instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 on hv-cinder-82549 Jul 12 07:26:31.958651 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-d79a3e57-df45-4d32-be43-8021a65b6c48 req-bcb420fe-d97d-4c16-9ba1-7f02b325f9bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029304 Jul 12 07:26:31.959439 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 567/1123] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:26:34.530533 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:26:34.531313 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Tue Jul 12 07:26:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:28:01.101521 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:01.103582 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_api:SELECT=20 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:01.104153 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=48 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:01.105671 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG dbcounter [-] [117998] Writing DB stats nova_cell1:SELECT=44 {{(pid=117998) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:01.110776 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-7c49419d-639e-4ecf-942e-41c4139fb516 req-eb9dd125-2f3a-46ab-88be-c689ba93f5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dc00cd-e8cb-41c3-8f5c-e85a84168561", "tag": "6af08d61-5ffe-4713-a4c7-8d512c338a1f"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:28:01.121079 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-fc69b9d5-823f-4cac-8e64-0ab338cc3db5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:01.121611 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fc69b9d5-823f-4cac-8e64-0ab338cc3db5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:01.128689 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-7c49419d-639e-4ecf-942e-41c4139fb516 req-eb9dd125-2f3a-46ab-88be-c689ba93f5d0 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:01.129381 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-7c49419d-639e-4ecf-942e-41c4139fb516 req-eb9dd125-2f3a-46ab-88be-c689ba93f5d0 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:01.129535 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc69b9d5-823f-4cac-8e64-0ab338cc3db5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:01.129860 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc69b9d5-823f-4cac-8e64-0ab338cc3db5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:01.130635 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc69b9d5-823f-4cac-8e64-0ab338cc3db5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:01.131044 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-fc69b9d5-823f-4cac-8e64-0ab338cc3db5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:01.142586 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-7c49419d-639e-4ecf-942e-41c4139fb516 req-eb9dd125-2f3a-46ab-88be-c689ba93f5d0 service nova] Creating event network-changed:6af08d61-5ffe-4713-a4c7-8d512c338a1f for instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 on hv-cinder-82549 Jul 12 07:28:01.148038 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-7c49419d-639e-4ecf-942e-41c4139fb516 req-eb9dd125-2f3a-46ab-88be-c689ba93f5d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049278 Jul 12 07:28:01.148920 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 568/1124] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:28:01.161393 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-fc69b9d5-823f-4cac-8e64-0ab338cc3db5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:28:01.248520 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-fc69b9d5-823f-4cac-8e64-0ab338cc3db5 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 204 len: 0 microversion: 2.1 time: 0.151448 Jul 12 07:28:01.253963 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 557/1125] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:28:01 2022] DELETE /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:28:01.259880 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-386d1fd0-5095-4470-9d8d-7caf3e516363 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:01.260309 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-386d1fd0-5095-4470-9d8d-7caf3e516363 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:01.267256 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-386d1fd0-5095-4470-9d8d-7caf3e516363 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:01.267705 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-386d1fd0-5095-4470-9d8d-7caf3e516363 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:01.268481 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-386d1fd0-5095-4470-9d8d-7caf3e516363 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:01.268909 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-386d1fd0-5095-4470-9d8d-7caf3e516363 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:01.412550 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-386d1fd0-5095-4470-9d8d-7caf3e516363 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:28:01.420237 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-386d1fd0-5095-4470-9d8d-7caf3e516363 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1579 microversion: 2.1 time: 0.165134 Jul 12 07:28:01.420800 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 569/1126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:28:01 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:28:02.443355 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-b6a0f17b-e8c2-4792-bc10-273f31f9bd7b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:02.444478 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-b6a0f17b-e8c2-4792-bc10-273f31f9bd7b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:02.454890 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b6a0f17b-e8c2-4792-bc10-273f31f9bd7b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:02.455328 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b6a0f17b-e8c2-4792-bc10-273f31f9bd7b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:02.456079 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b6a0f17b-e8c2-4792-bc10-273f31f9bd7b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:02.456506 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-b6a0f17b-e8c2-4792-bc10-273f31f9bd7b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:02.873222 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-b6a0f17b-e8c2-4792-bc10-273f31f9bd7b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:28:02.881628 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-b6a0f17b-e8c2-4792-bc10-273f31f9bd7b tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1579 microversion: 2.1 time: 0.445417 Jul 12 07:28:02.882195 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 558/1127] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:28:02 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1579 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:28:03.642847 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-19613773-a8ad-43ae-b1da-df780381702b req-59542199-0426-4a7d-bdbf-b77bb9467d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dc00cd-e8cb-41c3-8f5c-e85a84168561", "name": "network-vif-deleted", "tag": "6af08d61-5ffe-4713-a4c7-8d512c338a1f"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:28:03.651700 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-19613773-a8ad-43ae-b1da-df780381702b req-59542199-0426-4a7d-bdbf-b77bb9467d94 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:03.652211 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-19613773-a8ad-43ae-b1da-df780381702b req-59542199-0426-4a7d-bdbf-b77bb9467d94 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:03.664302 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-19613773-a8ad-43ae-b1da-df780381702b req-59542199-0426-4a7d-bdbf-b77bb9467d94 service nova] Creating event network-vif-deleted:6af08d61-5ffe-4713-a4c7-8d512c338a1f for instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 on hv-cinder-82549 Jul 12 07:28:03.669306 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-19613773-a8ad-43ae-b1da-df780381702b req-59542199-0426-4a7d-bdbf-b77bb9467d94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029960 Jul 12 07:28:03.670050 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 570/1128] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:28:03.899115 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-475ef8b0-b432-466d-9ccd-6d2149b72058 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:03.899719 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-475ef8b0-b432-466d-9ccd-6d2149b72058 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:03.907869 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-475ef8b0-b432-466d-9ccd-6d2149b72058 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:03.908304 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-475ef8b0-b432-466d-9ccd-6d2149b72058 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:03.909071 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-475ef8b0-b432-466d-9ccd-6d2149b72058 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:03.909527 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-475ef8b0-b432-466d-9ccd-6d2149b72058 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:03.978749 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-475ef8b0-b432-466d-9ccd-6d2149b72058 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:28:03.987494 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-475ef8b0-b432-466d-9ccd-6d2149b72058 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 200 len: 1226 microversion: 2.1 time: 0.092189 Jul 12 07:28:03.988349 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 559/1129] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:28:03 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 07:28:05.006401 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:05.007085 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 81dc00cd-e8cb-41c3-8f5c-e85a84168561] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:05.013504 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:05.013942 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:05.014686 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:05.015109 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:05.028245 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] HTTP exception thrown: Instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 could not be found. Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Request method failure captured: Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 HTTP/1.1 Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSDQmrgkmtX7eorMogWXZkLrZuvlY928hlxPEqjaMHTQmUvvrZyuaWsX82yxQC2gNGTh5SS-NZo8mOtj5xDgc4iCmWqtREPyuy5W9JCvDx0V_cND854upHr3qtCowxGMJ64AgRToJQq4XWWGtF_x5LK6cdUrYLZDxSbOS4kqTOI2jCI Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:28:05.029857 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/883812495f3940a3bdeff8d4c08a29c3"}]}] Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 5279c7bf349746b4a4622f72945662ea Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 could not be found. Jul 12 07:28:05.031895 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '81dc00cd-e8cb-41c3-8f5c-e85a84168561'} Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 could not be found. Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:28:05.033042 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 could not be found. Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 could not be found. Jul 12 07:28:05.035368 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:05.036844 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Returning 404 to user: Instance 81dc00cd-e8cb-41c3-8f5c-e85a84168561 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:28:05.036844 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-76bdf90c-4a4d-44ba-9d05-4ef02d398f5c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561" status: 404 len: 111 microversion: 2.1 time: 0.029882 Jul 12 07:28:05.036844 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 571/1130] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:28:05 2022] GET /compute/v2.1/servers/81dc00cd-e8cb-41c3-8f5c-e85a84168561 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:28:08.153266 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-13ac62a8-21d9-4b96-b655-9fbaadc88b03 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:08.153802 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-13ac62a8-21d9-4b96-b655-9fbaadc88b03 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:08.155902 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-29f3773a-0ec6-4739-bb7d-faa591f52f61 req-79c69adb-600c-4ea6-a4e2-fa59c8d14a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d2c727-3181-42c2-a071-fa7eec04b391", "tag": "790fc29e-5907-4b44-bcfc-4b171e467d88"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:28:08.160708 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-13ac62a8-21d9-4b96-b655-9fbaadc88b03 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:08.161177 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-13ac62a8-21d9-4b96-b655-9fbaadc88b03 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:08.161935 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-13ac62a8-21d9-4b96-b655-9fbaadc88b03 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:08.162358 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-13ac62a8-21d9-4b96-b655-9fbaadc88b03 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:08.164877 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-29f3773a-0ec6-4739-bb7d-faa591f52f61 req-79c69adb-600c-4ea6-a4e2-fa59c8d14a18 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:08.165350 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-29f3773a-0ec6-4739-bb7d-faa591f52f61 req-79c69adb-600c-4ea6-a4e2-fa59c8d14a18 service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:08.176951 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-29f3773a-0ec6-4739-bb7d-faa591f52f61 req-79c69adb-600c-4ea6-a4e2-fa59c8d14a18 service nova] Creating event network-changed:790fc29e-5907-4b44-bcfc-4b171e467d88 for instance f0d2c727-3181-42c2-a071-fa7eec04b391 on hv-cinder-82549 Jul 12 07:28:08.182889 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-29f3773a-0ec6-4739-bb7d-faa591f52f61 req-79c69adb-600c-4ea6-a4e2-fa59c8d14a18 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031149 Jul 12 07:28:08.183487 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 572/1131] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:28:08.189289 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-13ac62a8-21d9-4b96-b655-9fbaadc88b03 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Going to try to terminate instance {{(pid=117998) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 07:28:08.270610 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-13ac62a8-21d9-4b96-b655-9fbaadc88b03 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 204 len: 0 microversion: 2.1 time: 0.120759 Jul 12 07:28:08.271477 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 560/1132] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:28:08 2022] DELETE /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 07:28:08.281297 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4c611aae-01a0-4a19-b519-d9b2dc126632 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:08.281992 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4c611aae-01a0-4a19-b519-d9b2dc126632 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:08.288830 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c611aae-01a0-4a19-b519-d9b2dc126632 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:08.289318 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c611aae-01a0-4a19-b519-d9b2dc126632 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:08.290079 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c611aae-01a0-4a19-b519-d9b2dc126632 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:08.290506 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c611aae-01a0-4a19-b519-d9b2dc126632 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:08.424523 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4c611aae-01a0-4a19-b519-d9b2dc126632 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:28:08.432736 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4c611aae-01a0-4a19-b519-d9b2dc126632 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1578 microversion: 2.1 time: 0.156091 Jul 12 07:28:08.433548 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 573/1133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:28:08 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:28:09.455296 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-408314fe-668c-441a-a8a7-491048afcc13 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:09.455961 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-408314fe-668c-441a-a8a7-491048afcc13 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:09.467846 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-408314fe-668c-441a-a8a7-491048afcc13 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:09.468517 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-408314fe-668c-441a-a8a7-491048afcc13 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:09.469969 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-408314fe-668c-441a-a8a7-491048afcc13 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:09.470625 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-408314fe-668c-441a-a8a7-491048afcc13 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:09.674219 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.policy [None req-408314fe-668c-441a-a8a7-491048afcc13 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117998) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:28:09.682346 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-408314fe-668c-441a-a8a7-491048afcc13 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1578 microversion: 2.1 time: 0.233959 Jul 12 07:28:09.682894 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 561/1134] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:28:09 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:28:10.700103 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a7ea0a7-f683-4038-ba3a-f25d8eebfd33 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:10.700695 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a7ea0a7-f683-4038-ba3a-f25d8eebfd33 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:10.707667 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a7ea0a7-f683-4038-ba3a-f25d8eebfd33 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:10.708116 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a7ea0a7-f683-4038-ba3a-f25d8eebfd33 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:10.708890 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a7ea0a7-f683-4038-ba3a-f25d8eebfd33 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:10.709345 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a7ea0a7-f683-4038-ba3a-f25d8eebfd33 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:10.850329 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a7ea0a7-f683-4038-ba3a-f25d8eebfd33 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5279c7bf349746b4a4622f72945662ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883812495f3940a3bdeff8d4c08a29c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 07:28:10.861303 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a7ea0a7-f683-4038-ba3a-f25d8eebfd33 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 200 len: 1460 microversion: 2.1 time: 0.164986 Jul 12 07:28:10.861935 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 574/1135] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:28:10 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 1460 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 07:28:10.916812 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [req-6b18628b-3e8a-4ab8-87fe-35ffc3ca94d5 req-ee95d6ee-3f53-4925-9b07-294ad7fd4fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d2c727-3181-42c2-a071-fa7eec04b391", "name": "network-vif-deleted", "tag": "790fc29e-5907-4b44-bcfc-4b171e467d88"}]} {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 07:28:10.925901 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-6b18628b-3e8a-4ab8-87fe-35ffc3ca94d5 req-ee95d6ee-3f53-4925-9b07-294ad7fd4fff service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:10.926337 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [req-6b18628b-3e8a-4ab8-87fe-35ffc3ca94d5 req-ee95d6ee-3f53-4925-9b07-294ad7fd4fff service nova] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:10.937667 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.compute.server_external_events [req-6b18628b-3e8a-4ab8-87fe-35ffc3ca94d5 req-ee95d6ee-3f53-4925-9b07-294ad7fd4fff service nova] Creating event network-vif-deleted:790fc29e-5907-4b44-bcfc-4b171e467d88 for instance f0d2c727-3181-42c2-a071-fa7eec04b391 on hv-cinder-82549 Jul 12 07:28:10.942710 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [req-6b18628b-3e8a-4ab8-87fe-35ffc3ca94d5 req-ee95d6ee-3f53-4925-9b07-294ad7fd4fff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029640 Jul 12 07:28:10.943511 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 562/1136] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 07:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 07:28:11.882385 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:11.883000 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: f0d2c727-3181-42c2-a071-fa7eec04b391] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:11.891508 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:11.892094 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:11.893278 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:11.893888 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:11.909075 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] HTTP exception thrown: Instance f0d2c727-3181-42c2-a071-fa7eec04b391 could not be found. Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Request method failure captured: Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 HTTP/1.1 Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSDQmrgkmtX7eorMogWXZkLrZuvlY928hlxPEqjaMHTQmUvvrZyuaWsX82yxQC2gNGTh5SS-NZo8mOtj5xDgc4iCmWqtREPyuy5W9JCvDx0V_cND854upHr3qtCowxGMJ64AgRToJQq4XWWGtF_x5LK6cdUrYLZDxSbOS4kqTOI2jCI Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:28:11.911130 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/883812495f3940a3bdeff8d4c08a29c3"}]}] Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 5279c7bf349746b4a4622f72945662ea Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance f0d2c727-3181-42c2-a071-fa7eec04b391 could not be found. Jul 12 07:28:11.912846 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': 'f0d2c727-3181-42c2-a071-fa7eec04b391'} Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d2c727-3181-42c2-a071-fa7eec04b391 could not be found. Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:28:11.913856 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d2c727-3181-42c2-a071-fa7eec04b391 could not be found. Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d2c727-3181-42c2-a071-fa7eec04b391 could not be found. Jul 12 07:28:11.915443 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:11.916912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Returning 404 to user: Instance f0d2c727-3181-42c2-a071-fa7eec04b391 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:28:11.916912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4591a5ec-2b33-4e9e-8698-1b8cf3184420 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391" status: 404 len: 111 microversion: 2.1 time: 0.036235 Jul 12 07:28:11.916912 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 575/1137] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:28:11 2022] GET /compute/v2.1/servers/f0d2c727-3181-42c2-a071-fa7eec04b391 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:28:12.402031 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:12.402612 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.compute.api [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117998) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:12.412510 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:12.412955 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:12.413758 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:12.414194 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG oslo_concurrency.lockutils [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117998) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:12.431261 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.wsgi [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] HTTP exception thrown: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Request method failure captured: Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: request: DELETE /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 HTTP/1.1 Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept: application/json Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Accept-Encoding: identity Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Connection: close Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Length: 0 Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Content-Type: application/json Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Host: 10.222.0.25 Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Openstack-System-Scope: None Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: User-Agent: python-urllib3/1.26.9 Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Auth-Token: gAAAAABizSDQmrgkmtX7eorMogWXZkLrZuvlY928hlxPEqjaMHTQmUvvrZyuaWsX82yxQC2gNGTh5SS-NZo8mOtj5xDgc4iCmWqtREPyuy5W9JCvDx0V_cND854upHr3qtCowxGMJ64AgRToJQq4XWWGtF_x5LK6cdUrYLZDxSbOS4kqTOI2jCI Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Id: None Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Domain-Name: None Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Identity-Status: Confirmed Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Is-Admin-Project: True Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Id: default Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Domain-Name: Default Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Project-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Role: member,reader Jul 12 07:28:12.432911 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Roles: member,reader Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/883812495f3940a3bdeff8d4c08a29c3"}]}] Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-Tenant-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Id: default Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Domain-Name: Default Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Id: 5279c7bf349746b4a4622f72945662ea Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: X-User-Name: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: method: > Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: exception: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.434557 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: action_args: {'id': '3776b5e2-d4ea-4709-9f38-44945b6ff3f3'} Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:28:12.435700 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.437463 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.439164 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Returning 404 to user: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. {{(pid=117998) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:28:12.439164 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-466e738c-6c6a-4f47-b7dd-4caf87911499 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 404 len: 111 microversion: 2.1 time: 0.040931 Jul 12 07:28:12.439164 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 563/1138] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 07:28:12 2022] DELETE /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:28:12.444153 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:12.444783 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [instance: 3776b5e2-d4ea-4709-9f38-44945b6ff3f3] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 07:28:12.451375 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:12.451808 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:12.452550 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 07:28:12.452975 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Lock "3e119ac6-6b57-4f90-ba6d-28f92a02395b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 07:28:12.466626 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] HTTP exception thrown: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Request method failure captured: Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 HTTP/1.1 Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Connection: close Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Host: 10.222.0.25 Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.9 Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABizSDQmrgkmtX7eorMogWXZkLrZuvlY928hlxPEqjaMHTQmUvvrZyuaWsX82yxQC2gNGTh5SS-NZo8mOtj5xDgc4iCmWqtREPyuy5W9JCvDx0V_cND854upHr3qtCowxGMJ64AgRToJQq4XWWGtF_x5LK6cdUrYLZDxSbOS4kqTOI2jCI Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Role: member,reader Jul 12 07:28:12.468142 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Roles: member,reader Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_883812495f3940a3bdeff8d4c08a29c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/883812495f3940a3bdeff8d4c08a29c3"}]}] Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 883812495f3940a3bdeff8d4c08a29c3 Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-TestVolumeBootPattern-1827585880 Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Id: 5279c7bf349746b4a4622f72945662ea Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-TestVolumeBootPattern-1827585880-project Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: method: > Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: exception: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.469872 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: action_args: {'id': '3776b5e2-d4ea-4709-9f38-44945b6ff3f3'} Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 07:28:12.474128 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. Jul 12 07:28:12.475609 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 12 07:28:12.477384 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Returning 404 to user: Instance 3776b5e2-d4ea-4709-9f38-44945b6ff3f3 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 07:28:12.477384 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5f04baaa-9974-4247-a6d3-198a797e552c tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3" status: 404 len: 111 microversion: 2.1 time: 0.030256 Jul 12 07:28:12.477384 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 576/1139] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 07:28:12 2022] GET /compute/v2.1/servers/3776b5e2-d4ea-4709-9f38-44945b6ff3f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 07:28:13.782874 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: DEBUG nova.api.openstack.wsgi [None req-9a655f40-27c9-4120-830b-cbf261786201 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] Calling method '.version_select at 0x7f7011b631f0>' {{(pid=117998) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 07:28:13.785985 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9a655f40-27c9-4120-830b-cbf261786201 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [5e44b354-24a6-4e02-a3f1-5c0a47d8268c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 07:28:14.795972 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [None req-9a655f40-27c9-4120-830b-cbf261786201 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] [5e44b354-24a6-4e02-a3f1-5c0a47d8268c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 46614. Jul 12 07:28:14.818984 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO nova.api.openstack.requestlog [None req-9a655f40-27c9-4120-830b-cbf261786201 tempest-TestVolumeBootPattern-1827585880 tempest-TestVolumeBootPattern-1827585880-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1485749986" status: 202 len: 0 microversion: 2.1 time: 1.040137 Jul 12 07:28:14.819806 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: [pid: 117998|app: 0|req: 564/1140] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 12 07:28:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1485749986 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 07:29:44.703387 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:29:44.704432 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Tue Jul 12 07:29:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:29:54.542016 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:29:54.542810 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Tue Jul 12 07:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:31:42.669309 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:31:42.670003 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Tue Jul 12 07:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:33:04.717745 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:33:04.718768 dv-cinder-825492-25-iscsi devstack@n-api.service[117997]: Tue Jul 12 07:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:33:14.553793 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:33:14.554779 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Tue Jul 12 07:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:33:15.879386 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:33:15.880496 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Tue Jul 12 07:33:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 07:33:36.510890 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 07:33:36.511622 dv-cinder-825492-25-iscsi devstack@n-api.service[117998]: Tue Jul 12 07:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!